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sr 
[his  study  Investigated   the  effect   of  usii  refrac- 

tion modols  upon  the  second  ordor  astronomic  latitudes  obtained  from 
observed   stars.      The  tbr*>o  refraction  models  used  wore  those  of   Bildini  , 
Garfinkr«l   and    tho  United   States  Coast  and   Geodetic   Survey.      It  was 
found  whon  usin£   the  mothod   of   observing  a   north  and   a    south    r.tnr   to 
obtain  tho   final  latitude,    that  no   significant  difference   existed  in 
the  final  combined   values  of  latitude  usinp;  any  of   the  refraction 
modols.      However,    the  difference  between  the  north   star  and   south   star 
values   of  latitude  were  slightly  larger  usinp;   the  Garfinkel  Model   than 
when  the  other  two  models  w«re  used. 
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CE  ..1 

PURPOSE  AIJD  SCOPE 

The  major  investigation  undortpk^n  in  this   thoci  c  is   tho   exami- 
ne! ion  of  the  effect  of   the  refraction  values  given  by  three  selected 
refraction  models  upon  tho  astronomical  latitudo  determined    from  a   set 
of  star  observations  at  a   given  station.      Tho  throe  refraction  models 
which  were  used  are   those  of   the  United  States  Coast  and  Geodetic 
Survey,    * -"      Baldini   *    '   and   Carfinkol   *-*'.      The  primary  objective  of 
the  project  has  boon  to  determine  whether  any  significant  difference  in 
the  final  value  of  the  astronomic   latitude  exists  when  each  of  the 
refraction  models  is   used.      This  would  also  include  any  effoct  on  the 
standard  error  of  the  mean  latitude  for  each  station.      The  next  objec- 
tive of  the  study  was   to  determine  if  any  model  was  sufficiently 
accurate  to  enable  tho  observer  to  obtain  his  latitude  position  by 
observing  one  single  star,   either  north  or  south,   in  place  of  the  current 
method  of  observing  both  a  north  and  south  star.      Finally,  it  was  attempt- 
ed to  suggest  a  method  which  would  include  an  adjustment  of  the  re- 
fraction coefficients   from  the  observed  data  at  a   station.      The  Garfinkel 
model  was   tho  modol  used   for  this  adjustment  project. 

The  observed  data  for  thirteen  second  order  latitudo  stations  in 
Southwestern  Ohio  were  used   for  this  investigation.      Each  of  these 
stations  was   reduced  using  oach   refraction  modol  and  the  results  com- 
pared.     This  is  listed  in  table  h.      The  IBM  709^  electronic  computer  was 
used  for  these  reductions  and  the  programs  were  written  in  the  SCATRAN 
language. 

In  addition  to  the  actual  station  reductions  various  aspects  of 
the  refraction  models  wore  investigated   to  determine  the  effects  caused 


by  the  variation  of  certain  assumed  values  or  constants  upon  tho  computed 
refraction.      This  was  performed  on  the  Baldini  model  to  determine  the 
effects   of  the  relative  humidity  and   the  wave  length  of  the  observed 
light  and  on  tho  Garfinkel  model  for  certain  constants.      The  refraction 
values  computed  by  each  of  tho  throe  models  for  various  zenith  distances 
were  compared  for  a   range  of  temperature  and  pressure  combinations  for 
selected  conditions. 

This  report  will  bo  generally  divided  into  five  main  sections 
in  addition  to  this  one.      The  second  section  will  contain  some  basic 
definitions  and  describo  selected  classical  theories  of  tho  variation 
of  tho   earth's  atmosphere.      Tho  third  section  will  briefly  describo  tho 
basic  assumptions  that  are  made  for  tho  throe  refraction  models  and 
list  their  final  computation  equations.      This  section  will  also  include 
tho  investigations  porformed  on  the  various  models  and  the  results  of 
tho  comparison  of  thoir  refraction  values.      The  fourth  section  will 
deal  with  tho  latitude  reduction  methods  used  in  this  study  and  tho 
results  obtained.      The  fifth  major  soction  will  be  devoted  to  tho 
adjustment  procedures  and  results  obtained  using  tho  station  data  and  a 
form  of  tho  Garfinkol  Refraction  Equation.      The  final  section  will  servo 
as  a  summary  and  a  statement  of  the  major  conclusions  of  tho  inves- 
tigation. 


CHAPTER  2 

BACKGROUND 
2.1   General 

For  this  paper,  astronomic  refraction  will  be  defined  as  the 
apparent  displacement  of  an  object  that  rosults  from  light  rays  from  a 
source  outside  the  atmosphere  being  bent  in  passing  through  the  atmos- 
phere,!") The  measure  of  this  quantity  is  the  change  produced  in  the 
direction  of  the  light  rays.   The  total  amount  of  this  change  depends 
on  the  density  of  the  various  strata  of  air  through  which  the  light  rays 

pass  and  upon  the  direction  of  these  strata  with  respoct  to  the  vertical. 
(2,7) 

It  is  the  consideration  of  the  constitution  of  the  atmosphere 
which  gives  rise  to  the  differences  in  the  various  proposed  refraction 
models.   The  atmosphere  of  the  earth  is  known  to  be  moro  dense  near  the 
surface  of  the  earth  and  gradually  decreases  in  density  to  its  upper 
limit.  For  our  purposes  the  upper  limit  of  the  atmosphere  will  bo  the 
point  at  which  the  density  is  so  low  that  its  offoct  on  a  ray  of  light 
is  negligible.   Since  this  condition  causes  the  ray  of  light  to  always 
pass  from  a  medium  of  lower  density  to  one  of  higher  density,  tho  result 
will  be  that  all  observed  objects  will  appear  to  be  highor  above  the 
horizon  than  they  actually  are.  Figure  1  shows  the  path  of  a  ray  of 
light  from  the  time  it  enters  the  atmosphere  until  it  is  seen  by  an 
observer.   (2,6,7) 

The  index  of  refraction  for  a  given  media  of  constant  density 
shall  be  defined  here  as  tho  ratio  of  the  sine  of  the  angle  of  incidence 
to  the  sine  of  the  angle  of  rofraction,  when  those  angles  are  measured 
with  respect  to  a  normal  to  the  boundary  surface  where  the  light  ray 
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Figure  1.     Refraction  Caused  by  the  Earth's  Atmosphere 


passes  into  tho  given  media   from  a  vacuum.      Tho  angle  of  incidonce  is 
measured  at  tho  boundary  surface  bofore  tho  ray  passo3  into  the  media 
and  the  angle  of  refraction  is  measured  after  it  has  passed  through  the 
boundary  surface. 
2.2     Classical  Theories  of  the  Variation  of  the  Earth's  Atmosphere. 

The  density  variation  of  tho  earth's  atmosphoro  from  tho  surface 
to  tho  upper  limit  is  assumed  to  be  subject  to  the  conditions  of 
equilibrium.      Therefore,   it  can  be  generally  stated  that  the  density 
varios  with  temperature  and  pressure.      Sinco  the  astronomic  refraction 
is  dependent  on  the  density,   it  may  also  be  related  to  the  variation  of 
the  temperature  and  pressure  of  the  atmosphere;      The  various  refraction 
tables  which  have  been  constructed  for  astronomical  use  rost  upon 
different  expressions  for  tho  variation  of  the  density  of  tho  atmos- 
phere with  the  altitude.      Four  of  tho  classical  theories  for  this  vari- 
ation will  be  reviewed  in  the  following  paragraphs. 

The  first  real  attempt  to  describe  the  variation  of  the  atmos- 
phere was  put  forth  by  Nowton.      This  hypothesis  assumed  a  constant 
temperature  at  all  altitudes.     Tho  relation  has  been  discarded  in  modern 

times  and  therefore  this  theory  should  be  considered  only  in  an  histor- 

(7) 
ical  sense.    v 

Bessel  proposed  that  the  density  could  be  expressed  in  terms  of 

altitude  only  and  therefore  assumed  no  law  of  temperature.   The  ratio  of 

the  densities  at  two  altitudos  is  expressed  as 

where  £  is  the  density  at  altitude  h  and  the  subscript  one  refers  to  the 
conditions  of  the  base  station.   K  is  a  constant  factor  used  for  com- 
putations ( 10=0.96^9 ). 


Ivory  put  forth  the  hypothesis  that  the  tumporaturo  dimini6hos 
at  a  uniform  rate  with  tho  height  at  all  altitudes.  This  roprosonts 
the  ratio  of  tho  densities  as 

-  o-  \-y 


where 


*, 


T=T»0-*lO    and  ^.-    ■^"'^  - 

In  this  relation  h0  is  the  altitude  at  which  the  atmosphere  would  tori- 
nate,  §  is  *  constant  factor  usod  to  rolato  the  temperature  (T)  at  a 
given  altitude  (h)  to  the  temporaturo  at  tho  base  station  (T.),  and 
the  exponent  y  is  expressed  in  toms  of  the  height  of  tho  base  station 
(hj)  and  $  . 

^     hi   Sft 

where  tho  value  of  Y  is  a  constant,  doponding  on  the  elasticity  of  air 
at  a  given  temperaturo  and  density,  *'' 

Tho  last  classical  hypothesis  to  bo  given  horo  states  that  tho 
temperature  diminishes  by  a  constant  fraction  of  its  absolute  amount  for 
every  unit  increase  in  altitudo.  This  is  in  tho  form  of  a  constant 
geometrical  progression  which  may  be  represented,  in  torms  of  the  ratio 
of  densities,  as 

where  V"  =■  -^r   (^^  »^  -  Q  V, 

The  small  g  represents  the  value  of  gravity  and  all  the  other  torms  havo 

been  previously  definod,  I'' 

Those  theories  havo  boon  presented  as  a  background  for  the 
discussion  of  the  specific  rofraction  nodols  with  whioh  wo  are  con- 
cerned in  the  next  section. 


CHAPTER  3 

REFRACTION  MODELS  INVESTIGATED  FOR  THIS  PROJECT 

3.1  General 

The  descriptions  of  the  throe  refraction  models  which  follow 
are  not  intended  to  bo  dotailod  discussions  of  the  procoduros  used  to 
derive  the  refraction  equations.  Rather,  they  simply  attempt  to  give 
the  basic  assumptions  upon  which  the  models  are  based  and  the  final 
forms  of  the  refraction  equations  used  for  computations.  It  will  bo 
attempted  to  point  out  any  limitations  introduced  into  the  models  and 
any  similarities  which  may  exist. 

Tho  computer  programs  used  for  the  practical  computations  with 
each  refraction  model  will  bo  gonorally  described  after  tho  basic 
discussion  of  each  model.   The  statements  listings  and  required  input 
data  for  each  of  the  programs  covered  may  be  found  in  Appendix  I, 

To  savo  repotition  with  each  refraction  modol,  some  basic  terms 
common  to  all  three  models  will  bo  defined  hero,   Tho  quantity  R  will 
always  roprosont  tho  astronomic  refraction.   Z  will  bo  tho  zonith 
distance  corrected  for  refraction  and  Zo  will  represont  tho  observed 
zenith  distance.   T  and  P  will  represent  tho  absolute  temporaturo  and 
pressure  respectively.   When  these  last  two  quantities  appear  with  tho 
subscript  (o)  they  will  refer  to  tho  conditions  at  tho  observation 
station.   All  other  quantities  will  bo  defined  when  they  appear  in  tho 
discussion  for  each  model. 

3.2  Tho  United  States  Coast  and  Geodetic  Survey  Refraction  Model 

This  refraction  model  is  based  on  a  thooretical  background  which 

is  combined  with  physical  data  to  produce  a  proposed  composition  of  tho 

(11) 
atmosphere.   This  modol  follows  that  proposed  by  Willis      and  is 


generally  based  upon  the  theories  of  Nowcomb.^'' 

First,  the  pressure  and  temperature  of  the  atmosphere  aro 
assumed  to  vary  with  rospect  to  the  density  in  the  relation  given  for 
a  perfect  gas.   This  relationship  is  given  as 

<?  =  ^ 

whore  ^?  is  the  density  and  k  is  a  constant  dopending  on  the  units  used 
and  the  gas  in  question.   Willis  assumed  that  the  temperature  and 
pressure  in  free  air  varies  according  to  the  relation  that 

where  the  relative  temperature  at  a  point  is  given  as  a  function  of  the 
relative  pressure.   The  relative  pressure  is  known  to  be  closely  re- 
lated to  the  mass  heights  of  the  atmosphere.   The  density  of  the  atmos- 
phere at  a  point  could  then  be  computed  after  the  pressure  and  temper- 
ature were  obtainod,  v3»l°; 

The  derivations  for  this  model  are  based  upon  the  assumption 
that  the  atmosphere  takes  tho  form  of  concentric  spherical  surfaces. 
These  may  be  described  as  horizontal  strata  which  are  of  equal  density 
and  follow  lovel  surfaces.  Any  ellipticity  of  the  actual  physical  sur- 
face is  neglected. >3t 11 ) 

Up  to  a  zenith  distance  of  60  degrees  a  first  approximation  of 
the  refraction  formula  may  be  given  as 

fc=  -rp-  tan  L. 
where  B  is  the  barometric  pressure  at  the  point  of  observation  and  k  is 
a  constant  whose  value  depends  on  the  units  of  temperature  and  pressure. 
For  a  more  accurate  value  of  the  refraction  and  for  zenith  distances 
over  60  degrees  more  terms  must  be  added  to  this  basic  expression. 
The  form  used  by  the  Coast  and  Geodetic  Survey  is 


8 


R-«<  ( tan  Z) [T- (\T- fc *) s ec % ) 
which  extends  tho  reliable  application  of  the  refraction  formula  to  a 
cenith  distance  of  70  degroos  or  more.      The  quantity -y^  nearly  equals 
the  rnfractive  index  of  the  air.     Tho  quantity  V""~    is  basod  on  the 
radius  of  curvature  of  tho  strata  and  proportios  of  tho  atmosphere  at 
the  station.      This  is  roughly  equal  to  ^33   •      This  formula  may  be 
expressed  as  a  part  of  an  infinite  serios  which  is  given  as 
R  «^£-  (tan  Z)(l-C„   seA  +  C.    sec4Z   -  C,   sec6Z  +  — ). 

The  C2  coefficient  ia  tho  quantity  \T«»i«c  and  the  remaining  coefficients 
depent  on  the  constitution  of  the  atmosphere.     Even  after  these  coeffi- 
cients  h-ivo  boon  determined  for  an  assumed  state  of  things,  tho  series 
ceases  to  converge  before  the  horizon  is  reached.     It  may  bo  used 
practically  for  computations  up  to  a  zenith  distance  of  83  or  84  degreos. 

For  the  practical  computation  of  the  refraction  a  logarithmic 
form  of  the  above  refraction  formula  is  used.     This  may  bo  represented 

as 

log     R  -  log  (tan  Z)   +   log     (   ^-)+   loglft(l-C0sec22) 

10  10  10      1+*.  10  2 

where  the  quantities  represented  by  tho  logarithms  are  terms  of  the 
refraction  formula  given  above.         $    and  Y  represent  departures  from 
the  standard  atmo3phorio  conditions  of  pressure  and  temperature.     The 
term  containing  Cp  is  added  as  a  correction  to  the    °<:/(l+<*)  terra  which 
varies  slowly  with  moderate  zonith  distance.     However,  when  this  term 
is  introduced  it  does  not  allow  the  whole  rofraction  equation  to  be 
taken  as  proportional  to  tenporature  and  pressure.     This  is  taken  into 
account  by  the  (>>  -lXX-f-^j)  torm  in  the  expression.     This  last  torm 
does  not  become  important  except  at  tho  largor  zenith  distances, O •   **' 
The  tables  published  for  this  refraction  model  wore  derived  for 


a  pressure  of  760  millimeters,  a  temperature  of  10  degrees  centigrade, 
a  wave  length  for  yellow  light  of  0.578  micron  and  a  relative  humidity 
of  60  per  cent.  Correction  tables  are  provided  for  differences  in  the 
observed  temperature  and  pressure  from  these  selected  values.   These 
tables  were  used  in  the  computations  for  this  investigation.^1   ' 

The  computer  program  used  for  the  Coast  and  Geodetic  Survey  Re- 
fraction Model  was  fairly  simple  and  straightforward.   The  refraction 

values  given  in  Table  V  of  the  U.  S.  Coast  and  Geodetic  Survey  Publi- 

(3) 
cation  No.  237    were  read  into  the  main  program  for  every  ten  minutes 

of  arc.  Since  these  values  were  computed  for  a  given  set  of  conditions, 
correction  coefficients  for  temperature  and  pressure  variations  had  to 
be  used.  These  were  taken  from  Tables  VI  and  VII  of  the  above  publi- 
cation.  These  correction  coefficients  were  introduced  into  the  sub- 
program using  literal  statements.   These  values  were  limited  to  a 
reasonable  range  of  temperature  and  pressure  for  the  reduction  of  the 
observed  data.   The  range  of  these  values  was  expanded  for  the  compari- 
son of  the  three  refraction  models  at  various  extremes  of  temperature 
and  pressure.   The  subprogram  was  made  up  of  three  search  loops  which 
computed  the  correction  values  for  the  given  temperature  and  pressure 
and  the  refraction  value  for  the  observed  zenith  distance.  All  of  these 
factors  were  then  multiplied  together  to  obtain  the  astronomic  refrac- 
tion. 
3.3  The  Baldini  Refraction  Model 

The  refraction  equations  in  this  model  are  derived  for  an 
object  inside  the  atmosphere  but  the  final  form  of  the  equations  is 
such  that  they  will  hold  for  an  object  at  infinity.  Since  it  is  assum- 
ed that  all  stars  are  at  infinity,  this  model  may  be  used  to  compute 
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astronomic  refraction. 

For  his  derivations  Baldini  assumed  a  spherical  earth  with  an 
atmosphere  arranged  in  spherical  layers.   Ho  adopted  the  conditions 
that  the  altitude  of  the  atmosphere  would  always  bo  less  that  64 
kilometers  and  the  observed  zenith  distance  would  bo  loss  than  75   de- 
grees.  This  altitude  limit  represents  the  maximum  height  of  strata  ovor 
which  tho  refracting  power  of  the  atmosphere  is  assumod  to  be  zero. 

In  this  model  Baldini  defines  n  as  the  index  of  refraction  of 
one  layer  in  the  atmosphere  and  n  +  dn  as  the  index  of  refraction  of 
the  next  layer.   He  states  his  basic  refraction  equation  in  tho  form 

R"  "  -.fen  g'tan  z  * 

where  Z  is  the  zenith  distance  of  tho  object  in  the  first  layer  of  the 
atmo3phere.with  an  index  of  refraction  n.   To  solve  this  equation  for 
the  refraction  expressions  for  dn/n  and  tan  Z  are  required.   To  obtain 
these,  since  both  are  a  function  of  tho  density  of  the  atmosphere, 
Baldini  used  the  relationship  for  density  at  various  altitudes  that 


S  -C   hi 


in  which  h     is  a  constant  and  ^o  is  the  density  at  the  observer's  loca- 
o 

tion  on  the  earth's  surface.    ^    is  the  density  at  an  altitude  h  in  the 

atmosphere.     After  determining  a  value  for  h     this  expression  becomes 

-  o.  \o»^  V» 

where  h  is  given  in  kilometers.   This  expression  is  similar  in  form  to 
the  relation  proposed  by  Bessel.^3' 

Using  these  relationships  the  final  form  of  the  refraction 
equation  for  an  object  at  infinity  becomes 

R  -  Ao(no-l)  tan  Zo  +  Aj^(no-l)  tan  lo  +   A2(no-l)  tan  Zo 
with  the  quantities  AQ,  A^,  and  A~  given  as 
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Ao  =  +0.99827 

Aj  =  -0.00130 
A2  =  +0.000006 
from  tho  derivations.      The  factor  (^c>-l)»   with'ho  as  the  index  of  refrac- 
tion at  the  observer's   station,   is  computed  from  the  equation  of  Barrel 
and  Soarsu     This  computation  is  done  in  two  stops  with  a  preliminary  com- 
putation being  performed  for  the  refractive  index  of  standard  air  at 
optical  frequencies.      This  value,   designated  as^>g,   is  obtained  using 
the  formula 

(ng  -1)  107  =  2.8760-'+  +  l6-288  +  Q*1^ 

>2      .         ^ 
where  )\  represents  the  light  wave  length  in  microns.      This  is  then  con- 
verted to  the  ambient  conditions  using  the  relationship  that 

C*o  -1)  s"ftg-l'    P     _  O.00OOO0O55 e 
1+^x760  1+^cct. 

where  e  is  the  partial  pressure  of  water  vapor  in  the  air,    c<  is  the 
coefficient  of  expansion  of  air  (O.OO367)  and  X>  is  the  temperature  in 
degrees  centigrade.      The  quantity  e.  is  obtained  from  the  relative  humid- 
ity and  a  table  of  saturated  vapor  pressures  for  various  temperatures. '*' 

The  computer  program  used  for  this  refraction  model  is  self- 
contained  in  its  own  subprogram.      Tho  computations  using  the  Baldini  Re- 
fraction Model  were  all  done  for  an  assumed  relative  humidity  of  60  per 
cent  and  a  light  wave  length  of  0.578  micron.      A  table  of  saturated  vapor 
pressures  for  selected  temperatures  was   entered  in  the  subprogram 
through  the  use  of  a  literals   statement.      A  search  loop  similar  to  those 
used  in  the  Coast  and  Geodetic   Survey  Model  program  was   employed  to 
obtain  the  saturated  value  of  e.    at  the  desired  temperature.      This 
value  was  modified  for  use  in  the  program  by  multiplying  it  by  the  rela- 
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tivo  humidity.      The  quantity  (n0  -1 )  was  then  computed  and  the  astro- 
nomic refraction  obtained  from  the  final  refraction  formula   given  above. 

3.31      Effects   of  Relative  Humidity  and  light  Wave  Longth 
on  the  Baldini  Model 

An  investigation  was  run  on  this  subroutine  to  determine  tho 
effect  of  differences  in  the  relative  humidity  and   tho  wave  length  of 
light  used  for  the  observation.     It  was  found  that  the  rofraction  varied 
very  little  for  a  range  of   lelative   humidity  from  10  to  90  per  cent. 
This  was   for  a   zenith  distance  range  of  0  to  85  degrees  with  comparisons 
being  made  at  evory  five  degrees  of  zenith  distance.      These  results  are 
included  in  Table  1  at  the  end  of  this  subsection. 

The  effect  of  the  wave  length  of  light  was   examined  for  wave 
lengths  ranging  from  0,^75  to  0.693  micron  which  is  tho  rango  of  the 
visible  spoctrum.      There  is  a   larger  variation  due  to  the  wave  length 
effect  than  was  found  with  the  relative  humidity.      The  differences  were 
as  large  as   three  seconds  of  arc  at  a   zenith  distanco  of  75  degrees. 
The  results  of  this  investigation  are  included  in  Table  2  at  the  end  of 
this   subsection. 

From  the  results  of  these  investigations  it  has  boon  assumed 
that  the  values  used  in  tho  computation  program  were  sufficiently  accu- 
rate as  there  was  very  little  variation  in  the  refraction  due  to  the 
relative  humidity  and  noarly  all  observable  stars  emit  light  in  the 
yellow  wave  length  region  of  0.578  micron. 
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3.^  The  Garfinkel  Refraction  Model 

The  Garfinkel  Modol  is  the  only  one  of  the  three  used  in  this  in- 
vestigation  which  was  designed  to  give  refraction  values  for  zenith  dis- 
tances up  to  and  greater  than  90  dogroos.   There  are  some  variations  in 
the  final  form  of  the  refraction  equation  for  this  model  among  the 
agencies  which  use  it.   Two  of  these  variations  will  bo  given  after  a 
discussion  of  tho  original  form  derived  by  Garfinkol. 

Garfinkel  selects  a  modol  for  tho  variation  of  the  donsity  of 
the  atmosphere  that  is  similar  to  the  modol  suggested  by  Ivory.  In  a 
model  of  this  type  the  temperature  diminishes  with  a  uniform  rate  re- 
gardless of  the  altitude.   Thi3  typo  of  model  is  called  a  polytropic 
model.  1-5' 

With  the  perfect  gas  law  assumed  to  hold  for  the  earth's  atmos- 
phere, the  density  relationship  is  given  in  its  final  form  as 

where  Q  is  the  relative  density  of  the  atmosphere  at  an  altitude  y 
above  the  observation  station.   The  quantity  n  is  called  the  polytropic 
index.   The  relative  temperature  is  considered  to  diminish  at  a  constant 
rate  to  the  point  where  the  altitude  is  y. .  Above  this  point  the  rela- 
tive temperature  is  considered  to  be  zero.  This  relation  may  be  given 

by 

T'=  -  ^ 
n+1 

where  T'  is  the  constant  rate  at  which  the  relative  temperature  de- 
creases.     The  relative  temperature  is  then  given  as 

Tfc  1  -  _Z- 

n+1 

where  the  condition  at  the  observation  station  would  be 

T  =  1     and     y  =  0. 
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It  nay  be  seen  that  using  this  relationship  for  the  temporaturo  the 
value  yj  must  satisfy  the  relation 

yx  -  n ■*  l 

for  the  relative  temperature  to  equal  zero  at  that  altitude.  ■" 

From  this  polytropic  relationship  Garfinkel  develops  a  formula 
in  which  he  expresses  the  refraction  as  a  power  series  which  is  a  func- 
tion of  the  observod  zenith  distance.   This  equation  is  of  the  form 

M0*w(  B0+B1W+B2W2+B3vP+ ) 

for  zenith  distances  that  are  less  than  90  degrees.   The  terms  which 
make  up  this  series  will  be  explained  in  the  following  paragraphs,^' 

In  the  derivation  of  the  final  form  of  this  refraction  equation 
there  are  some  constants  which  appear.  The  most  important  of  these  are 
called  K0,  ^  0  and  Y0.   These  are  affected  by  local  conditions  at  the 
observing  station  as  well  as  the  choice  of  a  value  for  the  polytropic 
index.  If  a  standard  set  of  conditions  is  chosen  and  theso  values  com- 
puted for  them,  these  values  can  be  converted  to  the  conditions  at  the 
observation  station  by  temperature  and  pressure  relationships.  *->' 

Some  factors  must  be  defined  before  the  above  three  constants 
can  be  computed.  When  the  index  of  refraction  is  denoted  by  IX.  Q   at 
the  observation  station,  a  quantity  <=c  0  is  defined  from 

<*o  =  (^o-D/z^b  • 
From  this  factor  a  value  C0  is  defined  as 

co  =  oCo(1+%)  • 
Finally,  a  factor  S0  is  defined  by 

^o 
where  Ho  is  the  "height  of  the  homegenous  atmosphere  for  an  ideal  gas" 

and  r  is  the  radius  of  the  earth  to  the  observer's  station.   This 
o 
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height,  Ho,  is  tho  height  to  which  the  atmosphere  would  oxtond  abovo 
the  earth  if  its  density  wore  the  same  as  at  the  point  of  observation 
and  the  pressure  was  equal  to  the  observed  prossuro,' 3»5y 

Using  the3o  values  from  tho  preceding  paragraph,  the  constants 
for  tho  standard  sot  of  conditions  can  now  bo  dofincd,  Thoso  values  are 
given  a  double  subscript  to  indicate  that  thoy  are  derived  for  certain 
stipulated  conditions  and  at  standard  temporaturo  and  pressure.  Thoso 
constants  are  defined  as 

<roo-£s0^  (n*  ir* 

Boo  "  2~6:cXo2  Cn  +  D"* 

Koo  "  2  COQ  X0Q   a(a  +  1)-^  • 
using  a  choson  value  for  n.  The  variation  of  all  tho  factors  dofinod 
for  the  standard  conditions,  except  temperature  and  pressure,  is  so 
small  that  it  mako3  no  significant  changos  in  tho  values  of  these  con- 
stants from  station  to  station*  Thoroforo,  working  values  for  these 
constants  nay  be  obtained  at  an  observing  station  from 

Xo   "Ooo 

Bo  -  Boo  W 

1 

K  »  KODT  ~*W 


where  W  is  the  "weather  factor"  and  is  obtained  from 

Wb  Po/To2 
where  PQ   and  To  represent  the  ratios  of  tho  pressure  and  temperature  at 
the  observing  station  to  those  standard  conditions  for  which  tho  values 
were  originally  computed,     Garflnkel  computod  these  constants  using  a 
value  of  5,000  for  n  and  obtained 

Xoo  m  8.1578 

$oo  «  0.03916 
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K0o  =  ^952" 
at  a  temperature  of  0  degreos  centigrade  and  a  pressure  of  760  milli- 
meters, v  5) 

From  these  constants  the  B  factors  of  the  power  series  are  de- 
fined as 

.     B.=  Koo^oo^i 
whero  ^  is  a  function  of  an  angle  theta.      This  angle  is  derived  from 
the  observed  zenith  distance  by  the  relationship  that 

cot9=    XTo"2  cot^0. 
^  may  also  be  expressed  in  terms  of  a  power  series  of  tane/i; 

The  refraction  equation  may  be  written  for  zenith  distances 
greater  than  90  degrees  using  the  above  quantities.     From  these  factors 
two  new  values  are  defined.      They  are 

\  cot'  Tiey2 


ci  -  2  B^cos2  %  o^2*1 


V  -      fo     tan2  e/2 


and 

V  - 

To' 

The  refraction  for  a  zenith  distance  greater  than  90  degreos  is  then 
obtained  from  the  formula 

fc=  T02V(C0+ClV+C2V2+C3V5+ ) 

which  is  also  expressed  in  the  form  of  a  power  series.  ^-5 J 

The  program  which  was  used  for  most  of  the  refraction  computa- 
tions was  that  of  the  Garfinkel  Modol  as  programmed  by  Aberdeen.   This 
program  was  translated  from  the  FORTRAN  II  version  into  the  SCATRAN  Lan- 
guage. It  basically  follows  the  summations  given  by  Garfinkel  in  his 
article  to  obtain  the  B.  factors.   The  rofraction  is  then  computed 
using  Garfinkel' s  power  series  formula  as  given  above.  This  program 
uses  updated  factors  for  Garfinkel 's  basic  constants.   These  are 
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n=  4.256 

Koo=  4472.8 

§00=  0.044385 

Voo=  8.7137 

which  are  computed  for  the  same  standard  conditions  of  temperature  and 

pressure  as  those  of  the  Garfinkel  article.      In  a  comparison  of  the 

program  using  the  two  sets  of  constants,  it  was  found  that  this  newer 

set  of  values  gives  a   smaller  amount  of  refraction  for  each  selected 

zenith  distance  than  when  the  original  Garfinkel  set  was  used.      This 

difference  has  a  magnitude  of  about  1.5  soconds  at  a   zenith  distance  of 

75  degrees.     This  comparison  is  containod  in  Appendix  I.     The  Aberdeen 

constants  were  used  for  all  reductions  and  model  comparisons  in  this 

project. 

Another  form  of  the  Garfinkel  Rofraction  Model  is  used  by  the 

Coast  and  Geodetic  Survey.^  '  This  method  computes  the  refraction  from 

the  formula 

R  -  To^/  (Nx  tan  B/2  ♦  No  tan3  B/2  +  N3  tan5  B/2 

+  N4  tan'  B/2) 

where  the  constants  are  given  the  values 

Nt  =  1050.61030 

N2  =     706.11502 

No  =     262.06086 

%  =     142.67293 
and  the  angle  B  is  the  same  as  the  angle  9  in  the  Garfinkel  article 
formulas.      The    X  factor  used  in  this  method  is  the  same  as  that  of  the 
Aberdeen  program. 

This  refraction  method  was  also  programmed  and  used  in  some 
reductions.     It  gives  slightly  lower  refraction  values  for  zenith 
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distances  up  to  70  degrees  and  slightly  higher  values  for  the  zenith 

distances  over  this  value  when  compared  to  the  Abordeen  program.   The 

difference  amounted  to  about  0.02  seconds  of  arc  at  a  zenith  distance  of 

75  degrees.   The  advantage  of  this  program  over  that  of  Aberdeen  is 

that  it  is  much  shorter  and  uses  about  one-fourth  of  the  computer  time 

for  the  same  purposes.   Appendix  I  contains  a  comparison  of  the  results 

of  this  subroutine  with  the  Aberdeen  values  for  one  selected  set  of 

temperature  and  pressure  conditions. 

Another  version  of  the  Garfinkel  refraction  equation  is  that 

used  by  the  Aeronautical  Chart  and  Information  Center  (ACIC).^  '  This 

obtains  the  refraction  from  the  equation 

R  -  Nj^  tan©  +  N2  tan3©+  N3  tan.^© 

in  which  the  angle  0  is  the  same  as  given  in  the  Garfinkel  article. 
This  system  uses  a  X  value  of  8.1578  which  is  the  same  as  Garfinkel* s 
original  value.   This  form  was  programmed  by  using  the  values  given  in 
Garfinkel 's  tables  for  the  various  theta  angles  as  the  N  factors  in  the 
refraction  equation.   This  version  was  used  only  as  a  comparison  for  the 
other  programs  given  above.  It  is  included  in  the  comparison  given  in 
Appendix  I. 

This  form  of  the  refraction  equation  was  used  as  a  basis  for  the 
adjustment  program  discussed  in  section  5.  N  factors  wero  assigned  for 
the  purposes  of  the  adjustment  and  a  Y  factor  of  8.7137  was  used  in  that 
program. 

3.^-1  Comments  on  the  Garfinkel  Program 

The  Garfinkel  model  was  found  to  give  the  greatest  difference 
between  the  computed  values  of  latitude,  from  the  observed  north  and 
south  stars,  of  the  three  refraction  models  usod.   The  Aberdeen  sub- 
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routine  was  then  used  with  difforont  values   of  Y      but  holding  all  other 
factors  constant.      This  would  be  equivalent  to  changing  the  coeffi- 
cients  of  the  K  „  and  ft terms  which  are  computed  from  V .      Those  co- 

OO  >  OO  x  0  oo 

efficients  are  given  as  2,0  by  Garfinkel.  It  was  found  that  a  highor  Y 
under  these  conditions  gave  less  difference  between  the  north  and  south 
star  computed  latitude  values  for  all  stations  examined.   There  were 
different  values  of  the  factor  which  gave  tho  minimum  spread  for  each 
station  but  they  all  wore  higher  than  tho  selected  value.   Thoso  values 
ranged  from  8.78  to  8.88  for  tho  minimum  closure  on  each  station.  How- 
ever, the  values  of  tho  factor  over  tho  8.78  levol  had  the  effect  of  re- 
versing the  error  in  somo  stations  when  it  was  used  to  roduce  all  the 
observed  stations.   Therefore,  any  values  higher  than  this  ono  would 
be  of  questionable  morit.   This  effect  was  to  basically  switch  tho 
positions  of  the  north  and  south  latitudes  when  compared  to  tho  com- 
bined value.   This  method  of  forcing  less  difference  between  the  north 
and  south  stars  is  not  given  as  a  proof  of  any  weakness  in  the  model 
but  is  considered  worthy  of  note  since  there  is  an  indication  that  an 
adjustment  in  the  constant  factors  for  tho  Kq0  and  ^>00  values  by  a 
slight  amount  might  result  in  a  more  accurato  refraction  modol.   This 
would  be  associated  with  a  new  higher  value  for  the  gamma  constant  that 
would  be  somewhere  between  the  Aberdoen  value  and  the  8,78  quantity 
mentionod  above.  Much  moro  study  and  research  would  be  requirod  boforo 
it  could  bo  decided  whether  the  noted  changes  were  either  roquirod  or 
practicable.  Tho  idea  is  put  forth  as  a  possible  area  for  future  re- 
search but  should  not  be  accopted  as  anything  more  meaningful  than  that, 

3.5  Comparison  of  the  Refraction  Values  Obtainod  from  tho  Three 
Refraction  Models, 

A  comparison  of  the  refraction  valuos  for  the  Baldini  Model, 
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the  Oarfinkol  Model  and  the  Coast  and  Geodetic  Survey  Model  was  made  for 
various  conditions  and  extremes  of  temperature  and  pressure.   These  com- 
parisons were  made  for  a  standard  relative  humidity  of  60  per  cent, 
light  wave  length  of  0,578  micron  and  over  a  range  of  zenith  distances 
from  0  to  90  degrees.  It  should  be  noted  that  the  form  of  the  Baldini 
model  goes  to  infinity  at  90  degrees  and  so  no  comparison  can  be  made 
there. 

It  should  also  be  noted  in  these  comparisons  that  the  Baldini 
Model  was  designed  to  be  used  only  for  observed  zonith  distances  up  to 
75  degrees  and  that  the  series  used  for  tho  Coast  and  Geodetic  Survey 
Model  becomes  questionable  after  a  zenith  distance  of  83  or  8*4-  degrees 
is  reached,*  •  -"  The  comparisons  were  made  though  to  see  how  close 
the  models  did  come.   Table  3  lists  the  refraction  values  for  various 
combinations  of  temperature  and  pressure  and  also  the  difference  in  the 
obtained  values  between  the  models.   This  is  done  using  the  Coast  and 
Geodetic  Survey  Model  as  an  arbitrary  standard  with  which  to  compare 
the  other  two  models. 

The  comparisons  show  that  the  Baldini  and  Coast  and  Geodetic 
Survey  Models  tend  to  agree  more  closely  throughout  the  range  of  tem- 
perature and  pressure  than  tho  Garfinkel  and  the  Coast  and  Geodetic 
Survey  Models.  However,  at  higher  temperatures  the  refraction  values 
given  by  the  Baldini  Model  tend  to  become  lower  than  those  given  by  the 
Coast  and  Geodetic  Survey  Model,  At  lower  temperatures  these  values 
are  higher  than  those  given  by  the  Coast  and  Geodetic  Survey  Model, 
The  widest  variation  between  the  Baldini  and  Garfinkel  Models  occur  at 
the  higher  temperatures.   The  relation  between  the  Garfinkel  Model  and 
the  Coast  and  Geodetic  Survey  Model  at  the  higher  zenith  distances, 
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over  &5   degrees,  varies  quite  sharply  with  tho  temperature.  In  this 
area  the  Garfinkel  Model  gives  higher  values  of  refraction  at  the  lower 
temperatures  than  the  Coast  and  Geodetic  Survey  Model  and  lower  ones  at 
the  higher  temperatures.  It  was  found  generally  that  the  refraction 
differences  appear  to  be  more  effected  by  the  variation  of  tomperature 
than  those  of  pressure.   All  the  modols  give  fairly  close  values  for  the 
refraction  up  to  a  zenith  distance  of  about  50  dogrees  in  which  area  the 
difference  is  about  0,3  seconds. 

For  the  comparisons  in  Table  3  "the  values  of  the  refraction  were 
rounded  to  the  nearest  0.1  second.  This  is  done  since  the  tables  for 
the  Coast  and  Geodetic  Survey  Model  are  only  given  to  this  accuracy. 
Since  the  errors  in  this  range  are  within  the  acceptable  limits  for 
second  order  work  this  factor  does  not  tend  to  affect  the  results  of 
this  investigation.   The  Aberdeen  subroutine  was  used  for  the  Garfinkel 
Refraction  Model  in  this  comparison. 
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TABLE  3 


REFRACTION  C  CM  PARI  SONS 

FOR  TOE 

THREE  REFRACTION  MODELS 

Coast 

Zenith 

and 

Difference 

from  Coast 

Distance 

Geodetic 

and 

Geodetic 

Survey  Model 

(decrees) 

Survey 

Baldini 

Garfinkol         Bal 

Garfinkel 

Temporature     -5°C     Prea 

isuro     711 

mm  Refraction  in 

seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

5.0 

5.0 

5.0 

0.0 

0.0 

10 

10.1 

10.1 

10.1 

0.0 

0.0 

15 

15.3 

15.^ 

15.4 

0.1 

0.1 

20 

20.9 

20.9 

20.9 

0.0 

0.0 

25 

26.7 

26.8 

26.8 

0.1 

0.1 

30 

33.0 

33.1 

33.2 

0.1 

0.2 

35 

4o.o 

40.1 

40.2 

0.1 

0.2 

t» 

46. 0 

48.1 

48.2 

0.1 

0.2 

45 

57.2 

57.3 

57.4 

0.1 

0.2 

50 

68.1 

68.3 

68.4 

0.2 

0.3 

55 

81.5 

81.8 

81.9 

0.3 

0.4 

60 

98.9 

99.0 

99.2 

0.2 

0.4 

65 

122.1 

122.4 

122.6 

0.3 

0.5 

70 

156.0 

156.2 

156.6 

0.2 

0.6 

75 

210.3 

210.6 

211.3 

0.3 

1.0 

80 

313.6 

313.9 

315.4 

0.3 

1.8 

85 

581.6 

611.7 

585.8 

30.1 

4.2 

90 

2035.6 

cxO 

2051.2 

c>o 

15.6 

Tempera tur 

e  -5°C     Pressure     737 

mm  Refraction  in  1 

seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

5.2 

5.2 

5.2 

0.0 

0.0 

10 

10.4 

10.5 

10.5 

0.1 

0.1 

15 

15.9 

15.9 

15.9 

0.0 

0.1 

20 

21.6 

21.7 

21.7 

0.1 

0.1 

25 

27.7 

27.7 

27.8 

0.0 

0.1 

30 

3^.2 

34.3 

34.4 

0.1 

0.2 

35 

41.5 

41.6 

41.7 

0.1 

0.2 

40 

49.8 

49.9 

^9.9 

0.1 

0.1 

45 

59.3 

59.4 

59.5 

0.1 

0.2 

50 

70.6 

70.8 

70.9 

0.2 

0.3 

55 

84.5 

84.7 

84.9 

0.2 

0.4 

60 

102.4 

102.7 

102.8 

0.3 

0.4 

65 

126.5 

126.8 

127.1 

0.3 

0.6 

70 

161.6 

161.9 

162.4 

0.3 

0.8 

75 

218.0 

218.3 

219.1 

0.3 

1.1 

80 

325.0 

325.4 

326.9 

0.4 

1.9 

85 

602.7 

634.1 

607.5 

30.1 

4.8 

90 

2109.6 

oc? 

2132.7 

OO 

23.1 

25 


TABLE  3  (CON'T) 


Coast 
Zenith  and 

Distance       Geodotio 
(decrees)        Survey 


REFRACTION  COMPARISONS 

FOR  THE 
THREE  REFRACTION  MODELS 
( Continued ) 


Baldini 


Garfinkol 


Difference  from  Coast 

and  Goodotic  Survey  Model 

Baldini         Garfinkel 


Temperature     -5  C 

0  0.0 

5  5.4 

10  10.8 

15  16. 4. 

20  22.3 

25  28.5 

30  35.3 

35  42.8 

40  51.3 

45  61.1 

50  72.8 

55  87.1 

60  105.6 

65  130.4 

70  166.6 

75  224.7 

80  335.1 

85  621.4 

90  2174.8 


Tempera 
0 

5 
10 

15 

20 

25 

30 

35 

40 

45 
50 
55 
60 

65 
70 

75 
80 

85 
90 


tur©    -5&C 
0.0 
5.6 
11.2 
17.0 
23.1 
29.5 
36.5 
44.3 
53.2 
63.3 
74.5 
90.3 
109.4 

135.1 
172.6 
232.8 
347.1 
643.7 
2253.1 


Pressure 

0.0 

5.4 

10.8 

16.4 

22.3 

28.6 
35.4 
42.9 
51.^ 
61.3 
73.0 
87.4 

105.9 
130.8 
167.0 
225.1 
335.5 
653.9 
OO 

Pressure 
0.0 
5.6 
11.2 
17.0 
23.1 
29.6 
36.7 
44.5 
53.3 
63.5 
75.6 

90.5 
109.6 

135.5 
172.9 
233.1 
347.5 
677.2 


760 


mm  Refracti 
0.0 
5.4 
10.8 

16.5 
22.4 

28.6 

35.5 
43.0 

51.5 
61.4 

73.1 

87.5 

106.1 

131.1 
167.4 

225.9 
337.2 

626.7 
2205.3 


on  in  seconds 

0.0  0.0 

0.0  0.0 

0.0  0.0 

0.0  0.1 

0.0  0.1 

0.1  0.1 

0.1  0.2 

0.1  0.2 

0.1  0.2 

0.2  0.3 

0.2  0.3 

0.3  0.4 

0.3  0.5 

0.4  0.7 

0.4  0.8 

0.4  1.2 

0.4  2.1 

32.5  5.3 

o^  30.5 


787  mm  Refraction 

0.0 

5.6 
11.2 
17.0 
23.1 
29.7 
36.7 
44.5 
53.3 
63.5 
75.7 
90.6 
109.8 

135.7 
173.4 
233.9 
349.2 

649.3 
2291.1 


in  seconds 

0.0  0.0 

0.0  0.0 

0.0    .  0.0 

0.0  0.0 

0.0  0.0 

0.1  0.2 

0.2  0.2 

0.2  0.2 

0.1  0.1 

0.2  0.2 

0.1  0.2 

0.2  0.3 

0.2  0.4 

0.4  0.6 

0.3  0.8 

0.3  1.1 

0.4  2.1 

33.5  5.7 

00  38.0 
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TABLE  3  (CON'T) 


REFRACTION  COMPARISONS 

FOR  THE 

THREI 

( Continued ) 

Coast 

Zenith 

and 

Difforonce 

from  Coast 

Distance 

Geodetic 

and  Geodetic 

Survey  Model 

(denroos) 

Survey 

Baldj  ni 

Baldinl 

Garf ')  nkol 

Tempera tur©     10°C 

Pressure 

711  mm  Refraction  in  seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

4.8 

4.8 

4.8 

0.0 

0.0 

10 

9.5 

9.6 

9.6 

0.1 

0.1 

15 

1^.5 

14.6 

14.6 

0.1 

0.1 

20 

19.7 

19.8 

19.8 

0.1 

0.1 

25 

25.3 

25.3 

25.4 

0.0 

0.1 

30 

31.3 

31.3 

31.4 

0.0 

0.1 

35 

37.9 

38.0 

38.1 

0.1 

0.2 

40 

45.5 

45.5 

45.6 

0.0 

0.1 

45 

54.2 

54.2 

54.4 

.    0.0 

0.2 

50 

64.5 

64.6 

64.8 

0.1 

0.3 

55 

77.2 

77.4 

77.5 

0.2 

0.3 

60 

93.6 

93.7 

93.9 

0.1 

0.3 

65 

115.6 

115.8 

116.1 

0.2 

0.5 

70 

147.7 

147.8 

148.2 

0.1 

0.5 

75 

199.2 

199.2 

199.9 

0.0 

0.7 

80 

297.0 

297.0 

298.0 

0.0 

1.0 

85 

550.7 

578.8 

551.2 

28.1 

0.5 

90 

1927.7 

O^ 

1874.3 

O^ 

-53.4 

Temperature     10  C  Pressure 

737  mm  Refraction  in  seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

4.9 

4.9 

4.9 

0.0 

0.0 

10 

9.9 

9.9 

9.9 

0.0 

0.0 

15 

15.0 

15.1 

15.1 

0.1 

0.1 

20 

20.5 

20.5 

20.5 

0.0 

0.0 

25 

26.2 

26.2 

26.3 

0.0 

0.1 

30 

32.4 

32.4 

32.6 

0.0 

0.2 

35 

39.3 

39.4 

39.5 

0.1 

0.2 

40 

47.1 

47.2 

47.3 

0.1 

0.2 

45 

56.2 

56.2 

56.3 

0.0 

0.1 

50 

66.8 

67.0 

67.I 

0.2 

0.1 

55 

80.0 

80.2 

80.4 

0.2 

0.4 

60 

97.0 

97.1 

97.4 

0.1 

0.4 

65 

119.8 

120.0 

120.3 

0.2 

0.5 

70 

153.1 

153.2 

153.7 

0.1 

0.5 

75 

206.4 

206.5 

207.3 

0.1 

0.9 

80 

307.8 

307.9 

309.0 

0.1 

1.2 

85 

570.7 

600.0 

571.6 

29.3 

0.9 

90 

1997.7 

O^ 

1948.1 

O& 

-49.6 
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TABLE  3  (CON'T) 
REFRACTION  COMPARISONS 


FOR  THE 

THREE  ] 

REFRACTION  MODELS 

(Continued) 

Coast 

Zenith 

and 

Difference 

from  Coast 

Distance 

Geodetic 

and  Geodetic 

Survoy  Model 

£dor;roes) 

Survey 

Baldini 

Garfinkcl 

Baldini 

Garfinkel 

Temporatur 

e  10°C     Pressure     760 

nun  Rofrectdon  in  seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

5.1 

5.1 

5.1 

0.0 

0.0 

10 

10.2 

10.2 

10.2 

0.0 

0.0 

15 

15.5 

15.6 

15.6 

0.1 

0.1 

20 

21.1 

21.1 

21.1 

0.0 

0.0 

25 

27.0 

27.1 

27.1 

0.1 

0.1 

30 

33A 

33.5 

33.6 

0.1 

0.2 

35 

40.5 

40.6 

40.7 

0.1 

0.2 

&0 

48.6 

48.7 

1*8.8 

0.1 

0.2 

^5 

57.9 

5».o 

>ti.l 

O.l 

0.2 

50 

68.9 

69.I 

69.2 

0.2 

0.3 

55 

82.5 

82.7 

62.9 

0.2 

0.4 

60 

100.0 

100.2 

100.4 

0.2 

0.4 

65 

123.5 

123.8 

124.1 

0.3 

0.6 

70 

157.8 

158.0 

158.5 

0.2 

0.7 

75 

212.8 

213.0 

213.7 

0.2 

0.9 

80 

317.3 

317.5 

318.6 

0.2 

1.3 

85 

588.4 

618.8 

589.7 

30.4 

1.3 

90 

2059.5 

0*0 

2013.7 

00 

-45.8 

Temperature  10°C     Pressure     787 

mm  Refraction  in  soconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

5.3 

5.3 

5.3 

0.0 

0.0 

10 

10.6 

10.6 

10.6 

0.0 

0.0 

15 

16.1 

16.1 

16.1 

0.0 

0.0 

20 

21.9 

21.9 

21.9 

0.0 

0.0 

25 

28.0 

28.0 

28.1 

0.0 

0.1 

30 

3^.6 

3^.7 

3^.8 

0.1 

0.2 

35 

42.0 

42.1 

42.2 

0.1 

0.2 

4o 

50.3 

50.4 

50.5 

0.1 

0.2 

45 

60.0 

60.0 

60.2 

0.0 

0.2 

50 

71.4 

71.5 

71.7 

0.1 

0.3 

55 

85.5 

85.6 

85.8 

0.1 

0.3 

6o 

103.6 

103.7 

104.0 

0.1 

0.4 

65 

127.9 

128.2 

128.5 

0.3 

0.6 

70 

163.5 

I63.6 

164.1 

0.1 

0.5 

75 

220.5 

220.6 

221.3 

0.1 

0.8 

80 

328.7 

328.8 

330.0 

0.1 

1.2 

85 

609.6 

640.8 

610.9 

31.2 

1.3 

90 

2133.6 

O^ 

2091.1 

0^ 

-42.5 

28 


TABLE  3  (CON'T) 


REFRACTION  COMPARISONS 

FOR  THE 

THREE 

( Continued ) 

Coast 

Zenith 

and 

Difference 

from  Coast 

Distance 

Geodotic 

1 

and  Geodetic 

Survoy  Model 

(dorroos) 

Survey 

Baldini 

Baldini 

Garfinkel 

Temperature     35"  C 

Pressure 

711  mm  Refraction  in  seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

4.4 

4.3 

4.4 

0.1 

0.0 

10 

8.8 

8.8 

8.8 

0.0 

0.0 

15 

13.3 

13.3 

13.4 

0.0 

0.1 

20 

18.1 

18.1 

18.2 

0.0 

0.1 

25 

23.2 

23.1 

23.3 

-0.1 

0.1 

30 

28.7 

28.7 

28.9 

0.0 

0.2 

35 

34.8 

34.8 

35.0 

0.2 

0.2 

40 

41.8 

41.7 

41.9 

-0.1 

0.1 

45 

49.8 

49.6 

49.9 

•  -0.2 

0.1 

50 

59.3 

59.1 

59.5 

-0.2 

0.2 

55 

71.0 

70.8 

71.2 

-0.2 

0.2 

60 

86.0 

85.7 

86.3 

-0.3 

0.3 

65 

106.2 

105.9 

106.6 

-0.3 

0.4 

70 

135.7 

135.2 

136.1 

-0.2 

0.4 

75 

183.0 

182.3 

183.4 

-0.7 

0.4 

80 

272.9 

271.8 

272.9 

-1.1 

0.0 

85 

506.1 

529.6 

501.3 

23.5 

-4.8 

90 

1771.5 

o^> 

I632.5 

0^2 

-139.0 

Temporature     35° C 

Pressure 

737  mm  Refraction  in  seconds 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

M 

4.5 

4.5 

0.0 

0.0 

10 

9.1 

9.1 

9.1 

0.0    . 

0.0 

15 

13.8 

13.8 

13.9 

0.0 

0.1 

20 

18.8 

18.7 

18.9 

-0.1 

0.1 

25 

24.1 

24.0 

24.2 

-0.1 

0.1 

30 

29.8 

29.7 

29.9 

-0.1 

0.1 

35 

36.1 

36.1 

36.3 

0.0 

0.1 

40 

43.3 

43.1 

43.5 

-0.2 

0.2 

45 

51.6 

51.5 

51.8 

-0.1 

0.2 

50 

61.4 

61.3 

61.7 

-0.1 

0.4 

55 

73.5 

73> 

73.8 

-0.1 

0.3 

60 

89.1 

88.9 

89.4 

-0.2 

0.3 

65 

110.1 

109.8 

110.5 

-0.3 

0.4 

70 

140.7 

140.1 

141.1 

-0.5 

0.4 

75 

189.7 

189.0 

190.1 

-0.7 

0.4 

80 

282.9 

281.8 

282.9 

-1.1 

0.0 

85 

524.5 

549.1 

519.8 

24.6 

-4.7 

90 

1835.9 

0-=> 

1695.9 

O^ 

-140.0 
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TABLE  3  (CON'T) 


REFRACTION  COMPARISONS 

FOR  THE 

THREI 

(Continued) 

Coast 

Zenith 

and 

Difference  from  Coast 

Distance 

Geodetic 

and  Goodotic  Survey  Modol 

(decrees) 

Survey 

Baldird                  nke! 

Paldjni          GarHnkol 

Temperature     35°  C 

Pressure 

760  mm  Refraction  in  soconds 

0 

0.0 

0.0 

0.0 

0.0                    0.0 

5 

4.7 

4.6 

4.7 

-0.1                    0.0 

10 

9.4 

9.4 

9.4 

0.0                    0.0 

15 

14.2 

14.2 

14.3 

0.0                    0.1 

20 

19.4 

19.3 

19.5 

-0.1                    0.1 

25 

24.8 

24.8 

24.9 

0.0                    0.1 

30 

30.7 

30.7 

30.8 

0.0                    0.1 

35 

37.2 

37.2 

37.4 

0.0                    0.2 

40 

44.7 

44.5 

44.8 

-0.2                    0.1 

45 

53.2 

53.1 

53.4 

-0.1                    0.2 

50 

63.3 

63.2 

63.6 

-0.1              0.3 

55 

75.8 

75.7 

76.1 

-O.i                 0.4 

60 

91.9 

91.7 

92.2 

-0.2                    0.3 

65 

113.5 

113.3 

114.0 

-0.2                    0.7 

70 

145.0 

144.6 

145.5 

-0.4                   0.5 

75 

195.6 

194.9 

196.1 

-0.7                   0.5 

80 

291.6 

290.6 

291.8 

-1.0                   0.2 

85 

540.7 

566.3 

536.2 

25.6                 -4.5 

90 

1892.7 

O^ 

1752.2 

0^>             -140.5 

Temperature     35  °C 

Pressure 

787  mm  Refraction  in  seconds 

0 

0.0 

0.0 

0.0 

0.0                    0.0 

5 

4.9 

4.8 

4.8 

-0.1                  -0.1 

10 

9.7 

9.7 

9.8 

0.0    .                0.1 

15 

14.8 

14.7 

14.8 

-0.1                    0.0 

20 

20.1 

20.0 

20.1 

-0.1                    0.0 

25 

25.7 

25.7 

25.8 

0.0                    0.1 

30 

31.8 

31.8 

31.9 

0.0                    0.1 

35 

38.6 

38.5 

38.7 

-0.1                    0.1 

40 

46.3 

46.1 

46.4 

-0.2                    0.3 

45 

55.1 

55.0 

55.3 

-0.1               0.3 

50 

65.6 

65.5 

65.8 

-0.1                    0.2 

55 

78.5 

78.4 

78.8 

-0.1                    0.4 

60 

95.2 

95.0 

95.5 

-0.2                    0.3 

65 

117.6 

117.3 

118.0 

-0.3                   0.4 

70 

150.2 

149.8 

150.6 

-0.4                   0.4 

75 

202.6 

201.9 

203.1 

-0.7                   0.5 

80 

302.1 

301.0 

302.2 

-1.1                 0.1 

85 

560.2 

586.5 

555.4 

26.3                -4.8 

90 

1960.8 

<^> 

1818.7 

O^             -142.1 

30 


T=  -5°C 
P=  787  mm 


T=  10°C 
P=  760  mm 


T=  35°C 
P=  711  mm 


20   30  kO      50   60   70   80 


ZENITH  DISTANCE 
(DEGREES) 

Figure  2.  Refraction  Variation  for  the  Coast  and  Geodetic  Survey  Model 
From  0  to  80  Degrees  Zenith  Distance 
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CHAPTER  k 

THE  LATITUDE  REDUCTION  METHODS 
4,1   Background  on  the  Reduction  of  Astronomic  Data 

The  latitude  reductions  for  this  project  were  done  by  two  compu- 
tatAon  methods  which  were  used  as  a  check  on  each  other  for  the  final 
valuos  obtained.   The  first  method  employed  is  that  given  by  Thorson 
in  the  Second  Order  Astronomical  Position  Determination  Manual  of  the 
United  States  Coast  and  Geodetic  Survey.^''  This  reduction  method  is 

based  in  turn  on  a  version  given  by  Chauvenet  in  A  Manual  of  Spherical 

( 2) 
and  Practical  Astronomy, v  '   Two  versions  of  this  method  were  used  with 

the  only  difference  being  the  use  of  higher  order  terms  in  the  second 
version  to  attempt  to  gago  their  effects  on  the  final  position.  The 
second  reduction  method  used  is  based  strictly  on  the  use  of  spherical 
trigonometry  and  the  astronomical  triangle.  A  method  outlined  by 
Chauvenet  was  used  in  the  final  formulation  of  this  method, (2) 

The  observed  data  available  for  this  investigation  included 
observations  for  Polaris  and  a  selected  south  star  at  each  station. 
The  maximum  zenith  distance  differences  between  the  two  stars  at  any  one 
station  was  just  less  than  two  degreos.   The  latitude  results  wore  re- 
duced for  both  stars  and  then  averaged  to  obtain  the  combined  value 
for  the  station,  A  standard  error  of  the  mean  value  obtained  in  aver- 
aging each  of  these  separate  latitudes  was  also  computed. 

Astronomic  latitude  may  be  defined  as  the  declination  of  tho 
zenith  of  the  observer.   An  alternate  way  of  stating  this  fact  is  to  say 
that  the  latitude  is  the  altitude  of  tho  observer's  pole.  Both  of  those 
definitions  of  latitude  will  be  used  in  explaining  the  reduction 
methods  motioned  above, ^' 
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Tho  reduction  methods  used  in  this  investigation  are  both  based 

on  the  general  spherical  trigonometry  formulas  which  are  derived  from 

tho  astronomical  triangle.   Those  gonoral  formulas  may  bo  stated  as 

sin  h  =  sincSsinS  +  cos  .'  cosS  cos  c 

cos  t  =  sin  h  -  sin  'sj  n  > 
cos  v'  cos  s 

with   y5  the  observer's  latitude,  h  the  altitude,  h   the  declination 

and  t  the  hour  angle  of  the  star  in  question.   Tho  differencos  in  the 

two  methods  are  jn  certain  approximations  that  are  made  and  in  tho 

final  method  of  use  of  the  quantities.   In  the  first  reduction  method, 

two  separate  means  are  used  to  reduce  the  north  and  south  stars, while 

in  the  second  reduction  method, the  same  general  application  is  made  to 

both  stars Z2,9^ 

4.2     Reduction  Method  Based  on  the  Use  of  Polaris  and  A  Circummoridian 
Star 

This  method  of  reduction  employs  different  methods  of  reduction 

for  the  pole  star  and  the  south  star.     Certain  approximations  are  made 

to  reduce  the  observed  position  of  the  star  to  the  observer's  meridian 

and  then  employ  the  definitions  given  above  to  determine  the  latitude 

of  the  station. 

For  the  polo  star,   the  latitude  will  be  treated  as  the  altitude 

of  tho  polo.      For  this  reduction, the  declination  will  be  replaced  by  the 

polar  distance  which  is  defined  as  90  degrees  minus  the  declination  of 

the  star.      Substituting  this  quantity  into  the  first  general  equation 

given  in  Section  4,1   gives  the  expression 

sin  h  =  sin  ^  cos  P  +  cos  0  sin  P  cos  t 

whore  P  represents   the  polar  distanco.      As  the  value  of  P  is   small  for 

Polaris   (loss   than  2  degrees),    the  latitude  may  bo  dovoloped  in  a   series 
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form  of  ascending  powers  of  P.      This  serios   expansion  gives  the  option 
of  using  as  many  terms  as  are  required  for  any  desired  precision. 
Chauvenet^    '   obtains   this   expansion  by  writing  the  latitude  equation  as 

<fi>    =  h  -  x 
where  x  is  a  small  correction  on  the  order  of  magnitude  of  P.      The 
series   expansion  for  x  is  given  as 

x  -  P  cos  t  +  P2  sin2  t  tan  h  -  l/3  P3  cos  t  sin2  t. 
This  expansion  is  accurate  to  0.01  seconds  of  arc.     After  substitution, 
the  final  latitude  expression  becomes 

<p  -  h  -  P  cos  t  +  i  P2  sin2  t  tan  h  -  l/3  P3  cos  t  sin2  t. 
A  factor  may  be  introduced  into  this  equation  to  convort  all  values  to 
the  same  units.      This  would  be  in  the  last  two  terms  where  a  value  of 
sine  of  one  second  of  arc,   to  the  appropriate  power,   is  introduced  as 
a  conversion  factor  if  P  is  in  seconds,      Thorson  does  not  use  the  last 
term  (P-*)  in  his  method  of  reduction.      This  limits  the  method  to  an 
accuracy  for  the  final  astronomic  latitude  of  somewhere  within  one 
second  of  arc.^2»'' 

To  reduce  the  circummeridian  star,   the  latitude  will  be  obtained 
from  the  declination  of  the  observer's  zenith.     Several  observations 
of  the  star  may  be  made  close  to  the  meridian  and  then  reduced  to  the 
meridian.      These  altitudes  observed  near  the  meridian  give  nearly  as 
accurate  a  result  when  reduced  to  the  meridian  as  if  the  observation 
were  taken  on  the  meridian.      This  accuracy  is  within  one  second  of  arc 
for  the  final  latitude  if  the  observations  are  within  30  minutes  of 
time  from  the  meridian  and  within  0.1  seconds  of  arc  if  the  observations 
are  within  15  minutes  of  time  from  the  meridian.^2' 

From  the  first  general  equation  of  Section  4,1,   Chauvenet^2' 
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develops  an  expression  for  the  zenith  distance  of  the  observed  star. 

Using  the  trigonometric  relation  for  the  hour  angle  that 

2  • 
cos  t  =  1  -  2  sin  j  t, 

the   zenith  distance  may  be  obtained   from 

cos  Z    =  sin  h  +  cos  ;  cos  •>  (2  sin     it) 

whore  Z  is   the  observed  zenith  distance  corrected  for  refraction.      .'    is 

introduced  into  the  equation  from  the  relation  that  on  the  meridian 

1   =  :  -  S 

for  a   star  south  of  the  observer's   zenith.      Using  the  relationship  that 
the  altitude  is   the  complement  of  the  zenith  distance,    the  expression 

may  be  written  as 

2 , 
cos  z    =  cos  z,   -  2  cos  /  cos  b    sin   it 

where  Z.  j[   is   the  zenith  distance  reduced  to  the  meridian.      This   equation 

is  then  developed  into  a  power  series  which  in  its  final  form  is 

expressed  as 


Z  j   s  .;'  -  Am  +  En 


where 


A  =  cos  ;  cos  S 
sin       i 

a2  4-    ~r 

D  =   A     cot      . 

m  =    <1  sin     \t 

n  =  sin     ~2t 
in  which  m  and  n  may  be  divided  by  tho  sine  of  one  second   to  put  these 
terms  in  seconds  of  arc.      For  practical  computations,    the  value  of 
may  be  used  in  place  of  *    to  determino   the  values   of  A  and   B.      An 

assumed  value  of  the  latitude  must  also  be  used  for  the  computations 
If  a  number  of  observations  are  takon,   a   series  of  these  equations  are 
obtained  and  an  average  value  of  2  j  will  result.      The  latitude  will 
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then  bo  obtained  from  the  expression 

+    21 
which  may  be  given  the  alternate  form 

<p   =    S  +  90°  -  ht. 
Using  the  values  determined  above,    this   equation  reduces  to 

<p     =     ^  +  90°  -  h  +  Am  -  Bn. 
In  practice  a  curvature  correction  for  the  time   elapsed  between 
the  direct  and  reverse  instrument  sightings  is  introduced.      This  is  given 
as 

mt  =  0.0001364  (AT5)2 
where    &  T5  is  the  elapsed  time  in  seconds  between  the  direct  and  reverse 
sightings.      This  correction  is  added   to  the  m  term  of  the  above  ex- 
pression.     Thorson  does  not  use  the  last  term  of  this   expression  (Bn) 
in  his  reduction.      The  value  of  the  assumed  latitude  used  in  this  method 

should  be  as  close  as  possible  to  the  expected  final  latitude  value, 
(2,9) 

4.3     A  Method  for  Obtaining  the  Astronomic   Latitudes  Using  Basic 
Spherical  Trigonometry 

This  reduction  method  once  again  makes  use  of  the  first  general 

equation  given  in  section  4.1    for  the  solution  to  the  astronomic 

triangle.      The  main  difference  between  this  method  and  the  one  given  in 

the  preceding  section  is  that  no  series   expansion  is  used  here   to  obtain 

an  expression  for  the  latitude.      Instead, two  auxiliary  variables,   d  and 

D,    are  introduced   so   that 

d  sin  D  =  sin  k 

d  cos   D  =  cos  £>     cos   t. 

For  convenience  another  auxiliary  variable,    V  ,   is  brought  into  the 

reduction.      This  variable  is  defined  by  the  relation 
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-  D  =  +   •  . 
After  substitution  the  general  equation  may  be  expressed  as 

d  cos  (vT  -  D)  =  sin  h. 
By  eliminating  d  from  the  final  solution,    the  final  computation 
equations  are  obtained.      These  equations  are  given  as 

tan  D  =   tan  o  sec   t 
cos  y  =  sin  h  sin  D  cosec  <S 

/   =  D  ±  V 

using   the  auxiliary  variables  defined  above.      The  first  equation  deter- 
mines D  which  is   taken  to  bo  always  less   than  90  degrees  and  positive 
or  negative  according  to  the  sign  of  the  tangent.      The  second  equation 
is  indeterminate  as   to  the  sign  of    tf    since  the  cosine  of  +  ?\    and  -  ^ 
are  the  same.      Therefore,    two  values   of  latitude  are  obtained  by  the 
third   equation;    however,    one  of  these  values  will  be  over  90  degrees 
and  can  be  discarded.     It  was  found  that  for  Polaris,   the  D  -  5y  value 
is   to  be  used  to  obtain  the  latitude.      For  the   south  star,    the  D  +  ^' 
value  gives   the  desired  result.      In  these  reductions  a  curvature 
correction  was  used  for  the   south  star  to  compensate  for  the   elapsed 
time  between  the  direct  and  revorse  pointings   of  the  instrument.      This 
is  of  the  form  Am.,    where  the  quantities  are  the  same  as  those  intro- 
duced in  the  preceding   section.      This  value  was   subtracted  from  that 
value  for  the  south  star  latitude  which  resulted  from  tho  D  +   ^ 
procedure.  (2,9) 
^.^     The  Station  Reductions  to  Obtain  the  Astronomic   Latitude 

Each  station  was  reduced  by  threo  methods   using  each  refraction 
model.      Tho  first  reduction  used  the  procedures  given  by  Thorson,    '9/ 
The  second  reduction  used  this   same  method  but  added  the  higher  order 
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terms  described  in  section  4.2  The  third  reduction  omployod  the  method 
outlined  in  section  4.3  All  of  those  reductions  wore  done  by  making 
use  of  a  computor  program  which  used  the  subroutines  for  each  refrac- 
tion model.   The  Aberdoen  subroutine  was  used  hore  for  the  Garfinkol 
Model.   Those  reduction  results  are  given  for  each  station  in  Table  4. 
As  a  chock  on  the  accuracy  of  the  reduction  program,  tho  first  sot  of 
reduction  results  for  the  Coast  and  Geodetic  Survey  Model  was  compared 
to  hand  computed  results  and  found  to  be  in  extremely  close  agreement. 
The  slight  differences,  of  a  maximum  value  of  0.02  seconds  of  arc,  may 
be  attributed  partially  to  the  fact  that  the  hand  computations  usod 
averaged  valuos  of  the  observed  altitudes  to  determine  the  trigonome- 
tric functions  used  in  the  reduction.   In  the  program  tho  function  was 
computed  directly  for  each  observed  altitude  (corrected  for  the  refrac- 
tion).  The  agreement  between  the  final  values  was  regardod  as  being 
within  the  accuracy  limits  required  for  this  investigation. 

In  general,  the  final  latitude  values  for  the  north  and  south 
stars,  as  well  as  the  combined  latitude,  agreed  closely  for  each  of  the 
three  programmed  methods  employed.   The  second  and  third  reduction  pro- 
grams were  generally  in  close  agroemont  in  their  results.  It  was  found 
that  these  two  programs  reduced  tho  differences  between  tho  computed 
latitudes  for  the  north  and  south  stars  by  nearly  0.1  second  when  com- 
pared to  the  results  of  the  first  method.   This  change  may  be  attrib- 
uted to  the  greater  accuracy  of  theso  programs. 

Thorson  states  that  if  all  field  requirements  are  met,  the  final 
computations  will  show  probable  errors  of  less  than  £  0.4  seconds  of 
arc.^"'   This  would  be  equivelent  to  a  standard  error  of  about  *  0.6 
seconds  of  arc.   All  of  the  observations  used  in  this  project  wore  with- 
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in  this  range.      Hie  standard   errors   for  the  mean  values  of  the  latitudes 

determined  by  each  reduction  method  are  given  in  Table  4. 

4.5     The  Effects  of  Refraction  Model  Errors   Upon  the  Computed 
Latitude  Values. 

The  latitude  may  be  computed   from  the  observed  zenith  distance 

of  a   star  using  the  definitions  given  in  soction  4.1     For  the  case  of  a 

star  observed  in  the  meridian,    the  latitude  could  bo  obtained  from  thr 

equations 

p  =  (90°-0  +  (90°  -  Z) 

or 

0-     S  -Z 
for  a   star  observed  north  of  the  observer's  meridian  and 

f  -    S  +  Z 
for  a   star  south  of  the  observer's  meridian.      In  these  equations  p  is 
the  latitude,    b    the  declination  and  Z  the  true  zenith  distance.     In  the 
case  of  a  circumpolar  star  observed  at  lower  transit,   the  declination 
would  have  to  be  replaced  by  its   supplement  in  the  equations  for  the 
north  star.      The  true  zenith  distance  is  obtained  by  adding  the  re- 
fraction to  the  observed  zenith  distance.      This  relationship  is   expressed 
by 

Z  =  ZQ  +  R 

where  Z  is  the  observed  zenith  distance  and  R  is  the  refraction  correc- 
o 

tion.   Substituting  this  expression  into  the  latitude  equations,  the 

relationships  are  given  as 

f   =  (90°  -  % )   +  (90°  -  Zq  -  R) 

or 

?    «    ^  -  ZQ  -  R 
for  the  north   star  and 
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.   =  ,+  Z  +  R 
o 

for  the  south  star. 

It  can  be  seen  from  the  above  expressions  that  the  refraction 
term  is  negative  in  them  to  obtain  the  latitude  from  the  north  star  and 
positive  when  latitude  is  obtained  from  the  south  star.   Since  the  signs 
of  the  refraction  terms  are  opposite  for  the  north  and  south  stAr  lati- 
tude reductions,  any  constant  error  in  the  refraction  model  from  which 
this  term  was  obtained  would  cause  an  opposite  effect  on  the  latitudes 
computed  from  the  two  stars.  If  the  refraction  model  gives  a  value 
for  the  refraction  correction  which  is  lower  than  it  should  be  for  all 
zenith  distances,  the  latitude  value  computed  for  the  north  star  will 
be  greater  than  it  actually  is,  and  the  latitude  value  from  the  south 
star  will  be  less  than  it  actually  is.   The  converse  case  is  true  if 
the  refraction  model  gives  refraction  values  that  are  consistently  high- 
er than  they  should  be. 

In  the  observations  which  were  used  for  this  investigation,  the 
recommended  procedure  had  been  followed  in  the  selection  of  the  stars. 
^"'  This  procedure  calls  for  selecting  the  north  and  south  stars  at 
nearly  equal  zenith  distances.  When  this  is  done,  since  we  have  seen 
that  the  refraction  gives  an  opposite  effect  for  the  two  stars,  the 
average  value  of  the  two  computed  latitudes  should  minimize  any  errors 
due  the  refraction  model.   Since  Polaris  was  used  as  the  north  star  in 
these  observations,  south  stars  with  a  zenith  distance  near  50  degrees 
were  selected. 

Even  when  this  averaging  of  the  two  latitude  values  is  done  to 

minimize  the  refraction  errors,  it  must  be  pointed  out  that  there  will 
still  be  errors  present  in  this  final  latitude  value  due  to  observation 
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and  instrument  conditions,  but  theso  should  bo  smaller  and  in  a  random 

distribution.   It  should  bo  noted  that  some  refraction  model  error  will 

still  be  present  after  the  latitudes  are  averaged  due  to  the  fact  that 

the  stars  are  not  at  exactly  the  same  zenith  distances  and  possibly  due 

to  atmospheric  conditions  at  the  timo  of  the  observation. 

Generally,  then,  it  will  be  stated  that  the  best  refraction 

modol  would  give  the  minimum  difference  between  the  values  of  latitude 

computed  from  observations  of  the  north  and  south  stars  at  any  given 

time. 

4.6  Evaluation  of  the  Results  Obtained  for  Latitudo  from  the 
Observation  Data. 

It  was  found  that  the  standard  error  of  the  mean  value  of  the 
computed  latitude  was  consistent  for  the  three  refraction  modols  in- 
vestigated.  This  is  true  for  the  latitudo  values  computed  for  the  north 
and  south  stars  as  well  as  the  combinod  latitude.  No  significant 
change  occurs  in  any  of  theso  standard  error  values  due  to  the  refrac- 
tion model  used  and,  in  fact,  very  little  change  occurs  when  no  refrac- 
tion model  at  all  is  used.   Those  values  can  bo  found  in  Table  k. 

The  combinod  latitudes  for  each  refraction  model  wero  found  to 
be  in  very  close  agreement  for  each  reduction  method  employ od,  with  no 
significant  difference  noted  for  second  order  results.   The  widest 
variation  among  these  values  is  in  tho  range  of  0.02  seconds.   Some 
variation  was  found  in  the  computod  values  for  the  latitudes  that  wero 
reduced  from  each  of  the  two  stars.   In  this  light,  it  was  found  that 
the  Coast  and  Geodetic  Survey  Model  gave  the  least  difference  between 
the  north  and  south  star  values  of  latitude.   The  Baldini  Model  gener- 
ally gave  just  a  slight  bit  more  spread  with  tho  Garfinkcl  Model 
giving  the  widest  range  betweon  these  two  valuos.   This  difference  in 
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spread  was  found  to  closely  equal  tho  refraction  differences.   In  all 
cases,  tho  difference  between  the  combinod  latitude  value  and  those  of 
the  north  and  south  stars  was  too  great  to  justify  using  the  observation 
or  just  one  star  to  determine  the  astronomic  latitude  of  a  station. 
This  is  using  the  criteria  stated  in  Section  4.4  for  the  accuracy  of 
tho  observations. 

The  reductions  were  done  for  both  the  Aberdeen  set  of  constants 
and  the  original  ones  suggested  by  Garfinkel  when  the  Garfinkel  Model 
was  used.   It  was  found  that  the  Aberdeen  values  gave  about  one  second 
less  in  the  difference  between  tho  north  star  and  south  star  latitude 
values  for  each  station.   This  was  true  for  all  of  the  stations  reduced. 
The  Coast  and  Geodetic  Survey  Garfinkel  program  was  used  for  the  reduc- 
tions also,  and  it  was  found  that  slightly  less  difference  was  obtained 
between  tho  north  and  south  star  latitudos  than  when  the  Aberdoen  pro- 
gram and  values  were  used.   This  difference  was  not  significant  for 
the  purposes  of  this  investigation,  having  a  magnitude  of  about  0.03 
seconds  of  arc. 

It  sould  be  noted  that  the  accuracy  of  the  combined  latitude 
would  be  affected  to  a  groater  degree  by  the  refraction  model  as  the 
difference  in  the  zenith  distances  of  the  observod  stars  increased. 
At  largo  zenith  distances,  the  refraction  model  would  also  have  more 
effect  on  tho  standard  errors  of  tho  mean  values  obtained  sinco  the  re- 
fraction becomes  much  greater  as  the  zenith  distance  increase;;. 

From  tho  rosults  given  in  Table  4,  it  can  be  stated  that  for 
second  order  latitudes  observed  using  a  north  star  and  a  south  star 
with  nearly  equal  zenith  distances,  any  of  the  three  refraction  models 
investigated  would  give  acceptable  rosults. 
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TABLE  4 

LATITUDE  REDUCTION  RESULTS 

USING  THE 

THREE  REFRACTION  MODELS 


Coast  and 

Refraction 

Geodetic 

Model 

None 

Survey 

Baldini 

Garf 3 nkel 

Station: 

Carr 

Temperature: 

20.88°C 

Pressure: 

735.2  mm 

Latitude 

39°     33' 

39°    32' 

39 c     32' 

39  °     32' 

North  Starr 

ii 

ii 

ii 

ti 

Program  1 

18.612 

12.088 

12.051 

11.824 

Std  Error  (+) 

0.361 

0.384 

0.385 

0.386 

Program  2 

12.191 

12.154 

11.927 

Std  Error(+) 

0.385 

0.386 

0.386 

Program  3 

12.188 

12.150 

11.923 

Std   Error(+) 

r> 

0.385 

0.386 

0.386 

South  Star 

39      31' 

Program  1 

08.132 

14.092 

14.097 

14.322 

Std  Error  (+) 

0.492 

0.493 

0.493 

0.493 

Program  2 

14.092 

14.098 

14.323 

Std  Error(+) 

0.493 

0.493 

0.493 

Program  3 

14.098 

14.105 

14.330 

Std  Error (+) 

0.493 

0.492 

0.492 

Combined 

39*     32' 

Program  1 

13.372 

13.070 

13.072 

13.072 

Std  Error (+) 

0.257 

0.257 

0.257 

0.257 

Program  2 

13.141 

13.125 

13.125 

Std  Error (+) 

0.257 

0.257 

0.257 

Program  3 

13.142 

13.127 

13.127 

Std  Error (+) 

0.257 

0.257 

0.257 

Difference 

N  and  S 

Latitudes 

it 

ti 

it 

it 

Program  1 

130.480 

2.003 

2.046 

2.498 

Program  2 

1.900 

1.9^5 

2.396 

Program  3 

1.910 

1.955 

2.406 
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TABLE  4  (CON'T) 

LAHTUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
( Continued ) 


Refraction 
Model 


None 


Coast  and 

Geodetic 

Survey 


Baldini 


Garfinkel 


Station:  Foust 

Temperature:     l6.90JC 
Pressure:  733.3  nim 


Latitude 

39"     42  • 

39~     41 • 

39°     41 ■ 

39°    4 

North  Star 

ti 

ti 

it 

ti 

Program  1 

16.067 

09.328 

09.275 

09.079 

Std  Error(+) 

0.726 

0.719 

0.719 

0.719 

Program  2 

09.428 

09.376 

09.184 

Std  Error (+) 

0.720 

0.719 

0.719 

Program  3 

09.423 

09.375 

09.177 

Std  Error (+) 

0.720 

0.720 

0.720 

South  Star 

39°     40' 

Program  1 

07.803 

11.469 

11.553 

11.738 

Std  Error(+) 

0.583 

0.584 

0.585 

0.584 

Program  2 

11.472 

11.556 

11.742 

Std  Error(+) 

0.584 

0.585 

0.584 

Program  3 

11.474 

11.558 

11.774 

Std  Error(  +  ) 

0.584 

0.584 

0.584 

Combined 

39°     42' 

Program  1 

11.934 

10.396 

10.415 

10.408 

Std  Error(+) 

0.424 

0.417 

0.416 

0.416 

Program  2 

10.449 

10.468 

10.460 

Std  Error(+) 

0.417 

0.416 

0.416 

Program  3 

10.448 

10.446 

10.461 

Std  Error(+) 

0.416 

0.416 

0.416 

Difference 

N  and  S 

Latitudes 

u 

ti 

ii 

ii 

Program  1 

128.264 

2.141 

2.278 

2.659 

Program  2 

2.044 

2.180 

2.558 

Program  3 

2.052 

2.184 

2.566 
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TABLE  4  (CON'T) 

LATITUDE  REDUCATION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
( Continued ) 


None 


Coast  and 

Geodetic 

Survey 


Baldini 


Garfinkel 


Station:  Haines 

Temperature:      15.88CC 
Pressure:  740.1  mm 


Latitude 

39°     33' 

39       32' 

39 l     32' 

North  Star 

u 

it 

it 

Program  1 

54.795 

47.310 

47.253 

Std  Error(  +  ) 

0.374 

0.377 

0.377 

Program  2 

^7.396 

47.337 

Std  Error(  +  ) 

0.377 

0.378 

Program  3 

47.390 

47.334 

Std  Error (+) 

0.378 

0.378 

South  Star 

39°     31* 

Program  1 

45.886 

50.786 

50.841 

Std  Error(+) 

0.220 

0.220 

0.220 

Program  2 

50.793 

50.864 

Std  Error(+) 

0.220 

0.220 

Program  3 

50.789 

50.884 

Std  Error (+) 

0.222 

0.221 

Combined 

39°     32' 

Program  1 

50.340 

49.050 

^9.047 

Std  Error (+) 

0.162 

0.162 

0.162 

Program  2 

49.092 

49.092 

Std  Srror(+) 

O.loi 

0.162 

Program  3 

49.090 

49.088 

Std  i>ror(+) 

0.161 

0.161 

Difference 

N  and  S 

Latitudes 

It 

11 

tt 

Program  1 

128.909 

3.476 

3.588 

Program  2 

3.397 

3.508 

Program  3 

3.398 

3.610 

39      32' 
it 

47.032 
0.377 

47.116 
0.378 

47.112 
0.378 

51.054 
0.220 

51.059 
0.220 

51.057 
0.221 

49.042 
0.162 

49.086 
0.161 

49.083 
0.161 


4.022 
3.943 
3.945 
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TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Coast  and 

Refraction 

Geodetic 

Kodol 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Head 

Temperature: 

15.88°C 

Pressure: 

738.9  mm 

Latitude 

39°    32' 

39°     30' 

39'"     30 ' 

39"     30 » 

North  Star 

it 

It 

it 

it 

Program  1 

01.838 

53.382 

53.301 

53.110 

Std  Error(+) 

0.304 

O.294 

0.294 

0.295 

Program  2 

53.464 

53.383 

53.193 

Std  Error(+) 

0.294 

0.294 

0.294 

Program  3 

53.459 

53.380 

53.188 

Std  Error(+) 

0.294 

0.293 

0.294 

South  Star 

39"     29' 

Program  1 

50.054 

55.740 

55.809 

55.993 

Std  Error(  +  ) 

0.3^7 

0.347 

0.3^6 

0.347 

Program  2 

55.747 

55.812 

55.998 

Std  £rror(  +  ) 

0.347 

0.346 

0.347 

Program  3 

55.7^5 

55.812 

55.996 

Std  Error(+) 

0.346 

0.3^6 

0.346 

Combined 

39*     30' 

Program  1 

55.944 

54.561 

54.554 

54.551 

Std  Error(+) 

0.275 

0.266 

0.265 

0.265 

Program  2 

54.604 

54.599 

54.595 

Std  Error(  +  ) 

0.265 

0.264 

0.264 

Program  3 

54.604 

54.595 

54.592 

Std  Error(+) 

0.265 

0.265 

O.265 

Difference 

N  and  S 

Latitudes 

it 

11 

11 

it 

Program  1 

131.785 

2.358 

2. 508 

2.882 

Program  2 

2.283 

2.429 

2.804 

Program  3 

2.287 

2.432 

2.808 
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TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Coast  and 


Refraction 

Geodetic 

Modol 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Hoyt 

Temperature: 

19.21  C 

Pressure: 

738.6  mm 

Latitude 

39°     40' 

39"     39f 

39°     39' 

39°     39' 

North  Star 

it 

it 

11 

11 

Program   1 

26.719 

19.949 

19.953 

19.740 

Std  Error(+) 

0.420 

0.456 

0.455 

0.455 

Program  2 

20.047 

20.052 

19.839 

Std   Error(+) 

0.452 

0.454 

0.454 

Program  3 

20.045 

20.049 

19.838 

Std" Error (+) 

« 

0.453 

0.454 

0.455 

South  Star"" 

39       38' 

Program  1 

18.996 

22.588 

22.618 

22.818 

Std   Error(+) 

0.382 

0.378 

0.378 

0.378 

Program  2 

22.589 

22.622 

22.818 

Std  Error(+) 

0.378 

0.378 

0.378 

Program  3 

22.589 

22.622 

22.824 

Std  Error(+) 

0.378 

0.379 

0.378 

Combined 

39°     39' 

Program   1 

22.857 

21.266 

21.283 

21.279 

Std  Error (+) 

0.339 

0.W 

0.348 

0.348 

Program  2 

21.319 

21.336 

21.333 

Std  Error(+) 

O.W 

0.348 

0.348 

Program  3 

21.317 

21.334 

21.329 

Std  Error(+) 

0.347 

0.348 

0.348 

Difference 

N  and  S 

Latitudes 

it 

11 

11 

ti 

Program  1 

127.722 

2.639 

2.666 

3.078 

Program  2 

2.542 

2.570 

2.994 

Program  3 

2.544 

2.573 

2.987 

50 


TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Refraction 
Model 


None 


Coast  and 

Geodetic 

Survey 


Baldini 


Garfinkel 


Station:  Imler 

Temperature:      20.53^C 
Pressure:  735.7  nun 


Latitude 
North  Star 
Program  1 
Std  Error(+) 
Program  2 
Std   Error(  +  ) 
Program  3 
Std   Error(+) 
South  Star" 
Program  1 
Std   Error(+) 
Program  2 
Std  Error(+) 
Program  3 
Std   Error(+) 
Combined 
Program  1 
Std   Error(+) 
Program  2 
Std  Error(+) 
Program  3 
Std   Error(+) 
Difference 
N  and  S 
Latitudes 
Program   1 
Program  2 
Program  3 


39"      32" 


39^     31 


39°  31' 


39°    31' 


43.329 

36.736 

36.723 

36.498 

0.295 

0.302 

0.302 

0.302 

36.834 

36.820 

36.597 

0.302 

0.302 

0.302 

36.829 

36.817 

36.594 

0.302 

0.302 

0.302 

39J     30' 

36.789 

39.541 

39.576 

39.785 

0.187 

0.187 

0.187 

0.187 

39.545 

39.577 

39.787 

0.187 

0.187 

0.187 

39.552 

39.584 

39.794 

0.187 

0.187 

0.187 

39°     31' 

40.058 

38.137 

38.149 

38.142 

0.187 

0.189 

O.I89 

0.189 

38.190 

38.199 

38.192 

0.189 

0.189 

0.189 

38.190 

38.201 

38.194 

O.I89 

0.189 

0.190 

26.540 

n 
2.805 

it 
2.854 

it 

3.288 

2.710 

2.756 

3.190 

2.722 

2.768 

3.200 
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TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Coast  and 

Refraction 

Geodetic 

Model 

None 

Survey 

Baldini 

Station: 

Lanum 

Temperature: 

12.98°C 

Pressure: 

733.6  mm 

Latitude 

39°     40' 

39''    39' 

39°     39 

North  Star 

tt 

H 

11 

Program  1 

50.997 

43.111 

42.998 

Std   Error(+) 

0.271 

0.256 

0.255 

Program  2 

43.213 

43.101 

Std   Error(+) 

O.256 

0.255 

Program  3 

43.208 

43.096 

Std   Error(+) 

0 

0.255 

0.255 

South  Star 

39       38' 

Program  1 

35.678 

^3.575 

43.686 

Std  Error(+) 

0.199 

0.199 

0.200 

Program  2 

43.578 

43.690 

Std  Error(+) 

0.199 

0.199 

Program  3 

43.580 

43.693 

Std  Error (+) 

0.200 

0.199 

Combined 

39°    39' 

Program  1 

43.388 

43.343 

43.3^1 

Std  Error(+) 

0.139 

0.131 

0.130 

Program  2 

^3.395 

^3.395 

Std  Error (+) 

0.130 

0.130 

Program  3 

43.393 

43.393 

Std  Error(+) 

0.130 

0.130 

Difference 

N  and  S 

Latitudes 

ii 

it 

it 

Program  1 

135.219 

0.464 

0.688 

Program  2 

0.366 

0.598 

Program  3 

0.372 

0.597 

Garfinkol 


39       39" 
•t 

42.825 

0.255 
42.928 

0.255 

42.923 

0.255 

43.862 
0.199 

43.862 
0.199 

43.876 
0.199 

43.3^3 
0.130 

43.393 
0.130 

^3.395 
0.130 


1.036 
0.934 
0.944 
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TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 

USING  THE 

THREE  REFRACTION  MODELS 

( Continued ) 


Coast  and 

Refraction 

Geodetic 

Kodel 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Meinfeller 

Temperature: 

16.85°C 

Pressure: 

737.3  mm 

Latitude 

39°     39' 

39'     37» 

39^    37' 

39°    37' 

North  Star 

n 

tt 

ti 

it 

Program  1 

07.178 

59.370 

59.318 

59.119 

Std   Error(+) 

0.239 

0.236 

0.236 

0.236 

Program  2 

59.452 

59.399 

59.201 

Std  Error(+) 

0.236 

O.236 

0.236 

Program  3 

59.449 

59.394 

59.196 

Std   Error(+) 

O.236 

0.236 

0.236 

South  Star 

39°     36» 

39      38' 

39      38' 

39      38' 

Program  1 

55.221 

OO.813 

00.877 

01.069 

Std  Error (+) 

0.248 

0.245 

0.245 

0.245 

Program  2 

00.818 

00.884 

01.074 

Std  Error(+) 

0.245 

0.245 

0.245 

Program  3 

00.818 

00.884 

01.074 

Std  Error(+) 

0.245 

0.245 

0.245 

Combined 

J)°     38' 

Program  1 

01.199 

00.092 

00.097 

00.094 

Std   Error(+) 

0.159 

0.159 

0.159 

Program  2 

00.137 

00.140 

00.137 

Std  Error(+) 

0.159 

0.159 

0.159 

Program  3 

00.133 

00.140 

00.135 

Std  Error(+) 

0.159 

0.159 

0.159 

Difference 

N  and  S 

Latitudes 

ti 

it 

it 

it 

Program  1 

131.956 

1.444 

1.558 

1.950 

Program  2 

1.366 

1.485 

1.873 

Program  3 

1.370 

1.490 

1.878 
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TABLE  4  (COK'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Coast  and 

Refraction 

Geodetic 

Model 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Owens 

Temperature: 

21.69&C 

Pressure: 

736.4  mm 

Latitude 

39^     40* 

39°    39' 

39"     39* 

39°     39' 

North  Star 

11 

11 

11 

11 

Program  1 

42.374 

36.151 

36.216 

35.982 

Std  Error (+) 

0.348 

O.360 

0.361 

O.36I 

Program  2 

36.254 

36.315 

36.084 

Std  Error (+) 

O.360 

O.36I 

O.361 

Program  3 

36.252 

36.315 

36.082 

Std  Error (+) 

O.36O 

0.361 

0.361 

South  Star 

J)u     381 

Program  1 

33.001 

39.283 

39.222 

39.455 

Std  Error(+) 

0.526 

0.514 

0.513 

0.514 

Program  2 

39.295 

39.235 

39.459 

Std  Error (+) 

0.509 

0.509 

0.509 

Program  3 

39.275 

39.218 

39.448 

Std  Error(+) 

0.519 

0.519 

0.519 

Combined 

39°    39' 

Program  1 

37.685 

37.716 

37.718 

37.716 

Std  Error(  +  ) 

0.301 

0.282 

0.281 

0.281 

Program  2 

37.774 

37.773 

37.774 

Std  Error(+) 

0.282 

0.281 

0.281 

Program  3 

37.762 

37.766 

37.766 

Std  Error(  +  ) 

0.285 

0.284 

0.284 

Difference 

N  and  S 

Latitudes 

ti 

11 

ti 

11 

Program  1 

129.373 

3.133 

3.006 

3.473 

Program  2 

3.042 

2.920 

3.385 

Program  3 

3.023 

2.903 

3.366 

54 


TABLE  4  (CON'T) 


LATITUDE  REDUCTION 

RESULTS 

USING  THE 

THREE  REFRACTION  MODELS 

( Continued ) 

Coast  and 

Refraction 

Geodetic 

Model 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Persinger 

Temperature: 

19.72^C 

Pressure: 

741.2  mm 

Latitude 

39°      33' 

39  °    321 

39  °     32' 

39"     32' 

North  Star 

i» 

n 

it 

it 

Program  1 

20.578 

13.098 

13.039 

12.820 

Std   Error  (+) 

0.264 

0.275 

0.276 

0.276 

Program  2 

13.199 

13.137 

12.921 

Std  Error (+) 

0.276 

0.277 

0.277 

Program  3 

13.197 

13.135 

12.917 

Std  Error (+) 

0.275 

0.276 

0.277 

South  Star 

39°    31' 

Program  1 

09.767 

14.775 

14.838 

15.046 

Std  Error(+) 

0.567 

0.561 

O.56I 

0.561 

Program  2 

14.782 

14.785 

15.055 

Std  Error(+) 

0.559 

0.559 

0.559 

Program  3 

14.776 

14.842 

15.051 

Std   Error(+) 

r) 

O.562 

0.562 

0.562 

Combined 

39      32' 

Program  1 

15.171 

13.937 

13.937 

13.935 

Std  Srror(+) 

0.314 

0.307 

0.307 

0.307 

Program  2 

13.989 

13.992 

13.985 

Std  Error (+) 

0.307 

O.306 

0.307 

Program  3 

13.987 

13.989 

13.985 

Std  Error(+) 

0.307 

0.307 

0.307 

Difference 

N  and  S 

Latitudes 

11 

n 

n 

n 

Program  1 

130.811 

1.777 

1.779 

2.227 

Program  2 

1.503 

1.708 

2.133 

Program  3 

1.580 

1.706 

2.134 
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TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Refraction 
Hodol 


None 


Coast  and 

Geodetic 

Survey 


Baldini 


Garfinkel 


Station:  Tarbill 

Temperature:     24.01°C 
Pressure:  737.9  nun 


Latitude 
North  Star 
Program  1 
Std   Error(+) 
Program  2 
Std  Error(+) 
Program  3 
Std   Error(+) 
South  Star 
Program  1 
Std  Error(+) 
Program  2 
Std  Error(+) 
Program  3 
Std  Error(+) 
Combined 
Program   1 
Std   Error(+) 
Program  2 
Std   Error (+) 
Program  3 
Std  Error(  +  ) 
Difference 
N  and  S 
Latitudes 
Program  1 
Program  2 
Program  3 


39°    33f         39°     32' 


39       32' 


39       32' 


08.683 

02.767 

02.788 

02.532 

0.395 

0.385 

0.385 

0.385 

02.870 

02.887 

02.633 

0.385 

0.385 

0.385 

02.685 

02.884 

02.630 

0.385 

0.385 

0.385 

39°     31' 

02.341 

04.563 

04.570 

04.806 

0.505 

0.510 

0.510 

0.510 

04.570 

04.573 

04.813 

0.511 

0.511 

0.511 

04.571 

04.578 

04.817 

0.509 

0.509 

0.509 

39°    32' 

05.510 

03.665 

03.677 

03.670 

0.165 

0.154 

0.154 

0.154 

03.720 

03.730 

03.723 

0.155 

0.154 

0.154 

03.720 

03.730 

03.722 

0.155 

0.154 

0.154 

tl 

11 

11 

11 

26.343 

1.796 

1.782 

2.274 

1.700 

1.686 

2.180 

1.706 

1.694 

2.187 
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TABLE  4  (CON'T) 

LATITUDE  REOUCATION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Coast  and 


Refraction 

Good otic 

Model 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Taylor 

Temperature: 

21.45CC 

Pressure: 

732.0  mm 

Latitude 

39°     41' 

39c     40' 

39^     40' 

39°    40' 

North  Star 

(i 

ti 

11 

11 

Program  1 

38.837 

32.646 

32.639 

32.407 

Std   Error(+) 

0.680 

0.689 

0.690 

O.69O 

Program  2 

32.730 

32.722 

32.490 

Std  Error(+) 

0.690 

0.691 

0.691 

Program  3 

32.728 

32.718 

32.490 

Std   Srror(+) 

0.690 

0.691 

0.691 

South  Star 

39°    39' 

Program  1 

31.123 

35.329 

35.355 

35.576 

Std  Error(+) 

0.294 

0.291 

0.291 

0.291 

Program  2 

35.388 

35.362 

35.585 

Std  Error(+) 

0.291 

0.291 

0.291 

Program  3 

35.33^ 

35.360 

35.583 

Std  Error(+) 

0.292 

0.292 

0.292 

Combined 

39  *    40' 

Program   1 

34.977 

33.987 

33.995 

33.992 

Std   Error (+) 

0.289 

0.296 

O.296 

O.296 

Program  2 

34.031 

34.038 

3^.036 

Std  Error(+) 

0.296 

0.297 

0.297 

Program  3 

3^.031 

34.038 

3^.035 

Std  Error(+) 

0.295 

O.296 

O.296 

Difference 

N  and  S 

Latitudes 

fi 

u 

11 

?! 

Program   1 

127.715 

2.683 

2.716 

3.168 

Program  2 

2.607 

2.641 

3.095 

Program  3 

2.606 

2.642 

3.093 
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TABLE  4  (CON'T) 

LATITUDE  REDUCTION  RESULTS 
USING  THE 
THREE  REFRACTION  MODELS 
(Continued) 


Coast  and 


Refraction 

Geodetic 

Model 

None 

Survey 

Baldini 

Garfinkel 

Station: 

Williams 

Temperature: 

16.75^ 

Pressure: 

730.4  mm 

Latitude 

39°    33' 

39°    32' 

39°     32' 

39°    32* 

North  Star 

II 

11 

11 

11 

Program   1 

33.210 

25.497 

25.377 

25.179 

Std  Error(+) 

0.367 

0.370 

0.370 

0.370 

Program  2 

25.524 

25.  404 

25.207 

Std  Error(+) 

0.370 

0.370 

0.370 

Program  3 

25.519 

25.401 

25.203 

Std   Error(  +  ) 

0.370 

0.371 

0.371 

South  Star 

39°    31' 

Program   1 

26.538 

28.509 

28.619 

28.800 

Std  Error(+) 

0.607 

0.599 

0.599 

0.599 

Program  2 

28.513 

28.626 

28.806 

Std  Error(+) 

0.597 

0.597 

0.597 

Program  3 

28.515 

28.626 

28.805 

Std  Error(  +  ) 

0.601 

0.601 

0.601 

Combined 

39°    32' 

Program  1 

29.874 

27.002 

26.999 

26.987 

Std   Error(+) 

0.3&3 

0.336 

0.336 

0.335 

Program  2 

27.019 

27.016 

27.006 

Std  Error(  +  ) 

0.334 

0.33^ 

0.334 

Program   3 

27.016 

27.013 

27.004 

Std   Error (+) 

0.335 

0.336 

0.336 

Difference 

N  and  S 

Latitudes 

n 

ti 

it 

11 

Program  1 

126.672 

3.012 

3.242 

3.621 

Program  2 

2.988 

3.222 

3.600 

Program  3 

2.996 

3.226 

3.602 
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CHAPTER  5 

A  SUGGESTION  FOR  AN  ADJUSTMENT  PROCEDURE 
USING  A  FORK  OF  THE  GARFINKEL  MODEL 
5.1   Background  for  the  Adjustment  Method 

Since  the  atmosphere  and  its  refraction  effects  can  be  varied 
by  the  conditions  which  provail  concerning  weather,  season  or  turbu- 
lance  at  any  given  time,  there  will  be  some  factors  which  can  not  be 
accounted  for  by  the  assumptions  for  which  the  refraction  model  has 
been  constructed.   These  effects  will  not  be  exceptionally  large,  but 
their  presence  can  effect  the  results  obtained  for  the  refraction  at  a 
station.   There  also  may  be  some  errors  in  th«  refraction  model  itself 
that  can  be  minimized  by  the  use  of  an  adjustment  procedure.  It  might 
then  be  possible  to  construct  an  adjustment  program  which  would  perform 
an  adjustment  on  certain  of  the  refraction  coefficients  in  order  to  give 
refraction  results  which  will  reflect  the  conditions  at  the  station 
where  the  observations  were  taken.  If  many  stations  were  treated  in 
this  manner,  then  the  coefficients  used  could  be  examined  for  any  general 
trends  exhibited.   This  could  lead  to  revisions  and  a  more  accurate  re- 
fraction model. 

To  truly  reflect  tho  differences  in  the  refraction  coefficients 
and  to  take  into  account  the  effect  of  any  observation  errors,  the 
General  Method  of  Adjustments^    should  be  used  for  this  typo  of  pro- 
ject.  This  method  considers  both  the  variation  of  assumed  parametors 
and  the  effect  of  the  observations.   This  system  was  used  in  an  in- 
vestigation conducted  to  determine  the  feasibility  of  this  suggested 
type  of  station  adjustment. 

In  the  investigation  conducted,  two  variations  of  the  samo 
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basic  form  were  employed.   Tho  first  form  used  the  condition  that  the 
values  of  latitude  computed  from  the  observation  of  the  north  and  south 
stars  should  be  the  same.   The  socond  form  is  more  general  and  assumes 
that  the  first  general  equation  derived  from  spherical  trigonometry  and 
the  astronomical  triangle,  given  in  Section  4.1,  should  be  satisfied 
for  the  observed  star  after  correction  for  the  refraction.   These  two 
methods  will  be  discussed  individually  in  tho  sections  to  follow. 
5.2  The  Form  of  the  Garfinkel  Refraction  Model  Selected 

The  form  of  the  Garfinkel  Refraction  model  suggested  by  ACIC 
v  '  was  chosen  for  this  adjustment  procodure.   This  form  was  discussed 
in  Section  3.^.   The  refraction  is  then  obtained  from  the  relation  that 
RaW  yf~To     (N  tan  e  +  N2  tan  3Q  +  tf  tan^e) 


where 


W  =  P/   ^ 
w  -  r/To 


tan  ©  =   To  Tan  Zn 

T  ° 

and  the  value  of  ft'  is  chosen  as  8.7137.   All  of  these  quantities  have 
been  previously  defined.   For  the  purposes  of  an  adjustment,  it  was 
considered  that  the  pressure,  temperature  and  gamma  factor  were  con- 
stant.  The  gamma  factor  used  here  is  not  tho  one  suggested  in  the  ACIC 
article  but  is  that  of  the  Aberdeen  and  Coast  and  Geodetic  Survey 
Garfinkel  programs  which  was  found  to  give  less  difference  in  tho  com- 
puted latitudes  of  the  north  and  south  stars.   Sinco  tan  Z  is  the  same 
as  cot  h0,  the  observed  altitude  was  substituted  into  the  adjustment 
equations  for  the  observed  zenith  distance.   The  assumed  parameters 
become  Nj ,  N2  and  N~  from  this  oquation.   These  factors  were  assumed 

from  the  refraction  rosults  given  by  the  Garfinkel  Model  for  zenith 
distances  in  the  kO   to  60  degree  range,  with  an  approximate  mean 
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value  taken  for  each  factor.   These  assumed  valuos  aro  given  in 

Appendix  II  along  with  an  explanation  of  the  adjustment  procedures. 

5.3  Adjustment  Method  Using  a  Mathematical  Structure  Dealing  with 
the  Latitudes  Computod  from  the  North  and  South  Stars 

In  this  method  the  mathematical  structure  is 

where  the  subscripts  denote  from  which  observed  star  the  latitude 
was  computed.   The  declination  is  considered  as  a  fixed  quantity  in 
this  adjustment.   The  observed  quantities  are  considered  to  be  the  hour 
angle  and  altitude  of  both  the  north  and  south  stars.   This  results  in 
a  B  matrix  with  dimensions  of  4  by  8  which  consists  of  the  partial 
derivatives  of  the  mathematical  structure  with  respect  to  each  of  the 
observed  quantities.   The  weight  of  all  of  the  observations  has  been 
considered  to  be  equal.   The  parameters  are  considered  to  be  the  three 
factors  from  the  refraction  equation  and  the  assumed  latitudo  used  for 
south  star  computations.   This  gives  an  A  matrix  of  dimensions  k   by  8 
which  consists  of  the  partial  derivatives  of  the  mathematical  structure 
with  rospect  to  the  parameters.   No  weights  were  assigned  the  parameters 
for  this  adjustment.   The  basic  formulas  used  to  obtain  the  corrections 
to  the  parameters  are  given  as 

AX  +  BV  +  W  =  0 
X  =  -(A,M"1A)"1A'MW 
M  =  BB1 
where  the  X  matrix  gives  the  corrections  to  the  assumed  parameters.    ' 
The  W  matrix  is  computed  for  oach  observation  and  each  element  is  the 
number  which  would  have  to  be  added  to  the  equation,  computed  from  the 
observed  values  and  assumed  parameters,  to  fulfill  the  condition  given 
by  the  mathematical  structure.   The  components  for  these  matrices  and 
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and  some  additional  information  on  this  adjustment  method  aro  given  in 

Appendix  II. 

5.^  Adjustment  Method  with  a  More  General  Mathematical  Structure. 

The  second  method  used  the  same  computed  quantities  but  a 
different  mathematical  structure  that  gives  a  condition  which  oach  ob- 
served star  must  fulfill.   This  mothod  has  the  same  parameters  and  fixed 
values  as  the  previous  method  but  has  a  3  matrix  with  the  dimensions  2 
by  16,  since  thore  are  only  two  observed  quantities  for  each  observation. 
These  are  the  hour  angle  and  the  altitude  of  each  observed  star.   The 
same  final  adjustment  matrix  equations  are  used  for  this  form  as  for 
the  previous  one.   This  is  a  more  general  form  and  if  it  were  found 
workable  would  give  moro  room  for  variation  in  the  stars  observed  as 
two  south  stars  could  be  substituted  for  the  north  and  south  star  of 
the  previous  mothod.   The  samo  thing  could  be  done  using  two  north 
stars  also.   This  method  could  be  expanded  to  use  more  data  than  that 
provided  by  just  two  stars  because  of  its  general  form. 

The  investigation  for  this  model  used  only  two  stars  duo  to  the 
lack  of  any  other  available  data.   The  matrix  components  used  and  other 
information  on  the  adjustment  aro  given  in  Appendix  II. 
5.5  Results  of  the  Adjustment  Method  Investigation 

The  results  obtained  from  the  investigation  of  those  two  suggest- 
ed adjustment  methods  are  not  in  any  way  conclusive  in  a  positive  sonso. 
It  was  found  that  the  observed  data  wore  too  strongly  correlated  to 
give  any  useable  results.   This  was  caused  by  a  vory  unstable  M  matrix 
which  in  turn  caused  tho  inverse  M  matrix  to  bo  non-symmetrical  and 
thereforo  caused  tho  adjustment  results  to  be  unuscablo.   This  corre- 
lation may  bo  due  to  the  fact  that  all  of  tho  observed  altitudes 
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were  within  two  dogroes  of  each  other. 

Therefore,  nothing  can  be  said  in  tho  way  of  constructive  con- 
clusions from  the  adjustment  results  except  that  they  do  not  work  for 
the  data  available  for  this  project.   A  suggested  positive  test  for 
these  methods  would  bo  to  observe  stars,  both  north  and  south  of  the 
zonith,  at  difforent  zenith  distances  and  hour  angles  and  then  uso  the 
adjustment  procedures.   Tho  reduction  procedures  for  theso  observations 
would  not  be  the  same  as  those  used  in  this  project  and  new  equations 
would  have  to  be  written  with  the  mathematical  structure  given  in 
Section  5»3»  as  "the  forms  given  in  Appendix  II  are  for  the  case  of  Polaris 
and  a  circummeridian  star.   A  difference  in  zenith  distancos  of  from 
20  to  30  degrees  is  recommended.   These  zenith  distances  should  be  ob- 
served up  to  about  70  degrees  for  the  study. 

If  this  type  of  station  adjustment  for  the  refraction  coeffi- 
cients was  found  feasible,  then  a  sequence  of  observations,  say  on  two 
stars,  could  be  taken  before  and  after  the  latitude  observations  at  the 
station.  It  would  be  bost  if  all  observations  wore  taken  at  a  single 
station  over  a  long  period  of  time  to  determine  any  consistent  differ- 
ences in  the  refraction  model.   Howover,  data  taken  at  difforent 
stations  could  be  usod  in  tho  project  for  comparison  purposes. 

If  it  were  proved  to  be  feasible,  this  typo  of  station  adjust- 
ment might  oventually  load  to  a  situation  whore  the  latitude  of  a 
station  could  be  determined,  for  second  order  accuracy,  with  the  obser- 
vation of  only  one  star.   The  station  adjustment  could  also  be  employed 
as  a  tool  for  determining  seasonable  variations  and  thoir  effocts  on 
the  refraction  model.   Thorofore,  the  idea  does  have  some  merit  and 

should  be  investigated  rather  throughly  before  boing  completely 
discarded. 
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CHAPTER  6 

SUMMARY  and  CONCLUSIONS 

The  basic  objective  of  this  project  was  to  determine  if  the 
refraction  model  used  in  second  order  astronomic  latitude  determinations 
had  any  effect  on  the  final  latitude  results.   The  method  of  observing 
both  a  north  and  south  star  at  nearly  the  same  zenith  distance  was  used. 
It  can  be  stated,  based  upon  the  results  of  this  project,  that  the  final 
combined  astronomic  latitude  is  not  significantly  affected  by  the  re- 
fraction model  used.   This  is  in  reference  to  the  three  refraction 
models  used  in  this  investigation.   It  may  also  be  noted  that  the  stand- 
ard error  of  the  mean  for  the  computed  latitudes  is  not  affected  to  any 
significant  degree  by  the  refraction  model  used  in  reductions. 

It  was  found  that  with  the  three  refraction  models  used,  that  it 
xjould  not  be  feasible  to  observe  just  one  star,  north  or  south,  with 
an  expectation  of  obtaining  results  of  acceptable  second  order  accuracy. 
This  is  based  on  the  consideration  that  a  standard  error  of  i  0.6. 
seconds  of  arc  would  be  the  acceptable  criteria.   The  spread  given  be- 
tween the  latitude  values  computed  for  the  north  and  south  stars  was 
greater  than  this  value  in  each  station  computed  and  for  each  refraction 
model. 

If  the  difference  or  spread  obtained  between  the  north  and  south 

star  latitudes  can  be  used  as  a  criteria,  it  can  be  seen  that  the 

Garfinkel  Model  gives  a  consistently  larger  difference,  at  the  zenith 

distances  observed  (about  50   degrees),  than  either  the  Coast  and 

Geodetic  Survey  Model  or  the  Baldini  Model.   These  latter  two  models 

give  results  very  close  to  each  other  in  all  the  stations  computed. 

In  a  comparison  of  the  refraction  models  at  various  temperatures 
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and  pressures,  which  ranged  to  extremes  of  each  quantity.   It  was  found 
that  the  Coast  and  Geodetic  Survey  and  the  Baldini  Models  are  consist- 
ently closer  to  each  other  in  the  refraction  for  a  specified  zenith 
distance,  except  for  zenith  distances  over  80  degrees,  than  the  results 
obtained  from  the  Garfinkel  Model.   Since  the  Baldini  Model  was  only 
designed  for  zenith  distances  up  to  75   degrees,  this  seems  to  be  a  good 
comparison.   It  must  be  noted,  however,  that  up  to  a  zenith  distance  of 
50  degrees,  the  difference  in  the  refractions  given  by  the  three  models 
is  less  than  0.3  seconds  of  arc.   The  Garfinkel  Model  is  the  only  one  of 
the  three  that  were  investigated  which  is  designed  to  give  refraction 
for  zenith  distances  of  90  degrees  or  larger. 

The  Baldini  Model  was  investigated  for  the  effects  of  relative 
humidity  and  the  wave  length  of  the  observed  light.   It  was  found  that 
the  humidity  did  not  have  a  very  significant  effect  on  the  refraction 
output  of  the  model  until  a  zenith  distance  of  about  70  degrees  was 
reached.   The  difference  in  wave  lengths  of  the  received  light  causes 
a  greater  variation,  but  its  effect  is  diminished  when  it  is  considered 
that  nearly  all  the  observable  stars  give  off  light  in  the  yellow  wave 
length  region  of  the  spectrum.   Consequently,  the  Baldini  model  was 
used  with  a  relative  humidity  of  60  percent  and  a  wave  length  of  yel- 
low light  equivalent  to  that  used  for  the  basic  theory  of  the  Coast 
and  Geodetic  Survey  Model.   The  results  for  the  Baldini  Model  would 
have  been  a  bit  more  accurate  if  the  relative  humidity  had  been  taken 
at  the  observing  stations  and  the  wave  length  of  the  observed  light 
known.   It  is  considered  that,  for  the  purposes  of  this  project, these 
factors  would  not  have  had  a  very  groat  influence. 

It  was  attempted  to  ascertain  if  an  adjustment  for  the  con- 


ditions  at  the  observing  station  could  be  made  to  improve  the  refrac- 
tior  ■iodel.   3ufiicient  data  were  not  available  to  determine  if  this 
adjustment  was  feasible.  It  is  suggested  that  this  area  could  be  one 
of  future  research  but  that  data  should  be  taken  at  a  variety  of  zenith 
distances  to  determine  if  the  adjustment  method  would  actually  improve 
the  refraction  results. 

Finally,  it  may  bo  said  that  the  three  refraction  models  in- 
vestigated in  this  project  are  adequate  for  second  order  latitude  de- 
termination employing  the  present  two  star  observation  methods;  how- 
ever, it  must  be  noted  that  none  of  these  refraction  models  gives  the 
ultimate  solution  to  the  refraction  problem  and,  therefore,  this  area 
still  remains  open  to  future  investigation. 
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APPENDIX 

I 


REFRACT! OK  PROGRAM  INFORMATION 

In  all  of  the  refraction  subprograms  used  in  this  investigation 
and   listed  in  this  Appendix,    the  input  and  output  values  are  in  the  same 
units.      For  the  calling  parameters   the  observed  zenith  distance  is  in 
radians,    the  tempera ture  is   in  degroes   centigrade,    the  pressure  is  in 
inches   of  mercury  and  the  relative  humidity  is  given  as  a  decimal  frac- 
tion.    All  the  subroutines  give  the  output  for  refraction  in  seconds  of 
arc.      The  requirements  of  each  specific  subroutine  will  now  be  listed. 

The  Coast  and  Geodetic  Survey  Subroutine  requires  that  the 

values  of  refraction  from  Table  V  of  U.   S.   GiGS   Special  Publication 

(3) 
237  be  read  into  the  main  program.      Since  these  are  listed  for 

every  ten  minutes  of  arc  this  consists  of  reading  in  5^1  values.     At 
the  same  time  a  corresponding  quantity  in  degrees  is  generated  by  the 
program.      The  Subroutine  is  called  with  the  calling  parameters  in  the 
following  order:     Relative  Humidity,    Temperature,   Pressure,    Zenith 
Distance      Literals   statements  are  included  in  the  subprogram  to  de- 
termine the  factors  for  temperature  and  pressure  conditions  due  to 
deviation  from  the  standard  conditions  assumed  for  the  computation  of 
the  tables.      These  values  are  from  Tables  VI  and  VTI  of  the  publication 
mentioned  above. 

The   Baldini  Subroutine  uses  a  literals   statement  to  includo  a 
table  from  which  the  water  vapor  pressure  at  the  observing  station  may 
be  computed.      This  is   Table  I   of  the   Baldini  article.  Hie  value 

"Slite"  in  the  program  is  the  wave  length  of  light  used  in  the  computa- 
tions.     This   subprogram  is  called  in  the  following  order:      Relative 
Humidity,    Temperature,    Pressure,    Zenith  Distance. 


All  of  the  Garfinkel  Subroutines  listed  in  this  Appondix  have 
the  same  calling  parameters.   These  are  called  in  the  following  order: 
Zenith  Distance,  Pressure,  Temperature.   In  all  of  the  programs  the 
gamma  factor  and  other  constants  used  are  included  through  the  use  of  a 
literals  statement. 

The  program  for  a  comparison  of  the  refraction  models  is  fairly 
straightforward.   It  reads  in  the  values  required  for  the  Coast  and 
Geodetic  Survey  Subroutine  and  then  proceeds  to  call  each  of  the  sub- 
routines given  above  to  determine  the  refraction  for  various  temperature 
and  pressure  combinations.   Since  these  combinations  range  to  extremes, 
the  Coast  and  Geodetic  Survey  Subroutine  had  to  be  extended  to  include 
temperature  and  pressure  correction  factors  for  the  entire  range.  This 
was  done  by  simply  expanding  the  literals  statement  for  these  factors 
to  cover  more  range  of  the  respective  tables  they  were  taken  from. 
This  expanded  form  is  not  shown  here. 

The  last  item  in  this  Appendix  is  a  comparison  of  the  various 
versions  of  the  Garfinkel  Subprogram.   The  Aberdeen  and  Coast  and 
Geodetic  Survey  comparisons  were  made  for  the  newer  constants  and  a 
gamma  factor  of  8.7137.   The  other  two  comparisons  used  Garfinkel' s 
original  constants  and  a  gamma  factor  of  8.1578. 


PROGRAM  STATEMENTS  AND  SCATRAN  SUBROUTINE 
FOR  THIS 
U.   S.  COAST  AND  GEODETIC  SURVEY  REFRACTION  MODEL 


DIMENSION  (RM(54l).ZA(54l))- 
START     READ  IMPUT,    USREF,    ((RM(K),K=0,1  ,K.LE540))- 
F     USREF     (12F5.1)- 

DO  THROUGH  ( TABLE), 1=0, 1 , I. L. 540- 
DO  THROUGH  ( TABLE), J=0,1, J.L.6- 
IJ  =  I  +  J_ 

ZA(IJ)  =  (1/6.0)  +  (J  *  0.1666666667)- 

TABLE     CONTTNUE- 

ZA(540)   =  90.0- 

SUBROUTINE  (RCGS)  =  REFCGS.    (HUM,  TEMP,  PRESS,  ZRS)- 

DIMENSION  (CENT(46),CTM(46),BAR(30),CBM(30))- 

U  Iff  VERS  AL  (RM.ZA)- 

ZDR  =  ZRS  *  57.2957797- 

LITERALS  (CENT.5. 0,5. 6. 6. 1,6. 7, 7. 2, 7. 8, 8. 3, 8. 9. 9. 4, 10.0, 
10.6,11.1,11.7.12.2,12.8,13.3.13.9.1^.^,15.0,15.6,16.1, 
16. 7, 17. 2, 17. 8, 18. 3, 18. 9, 19. ^,20. 0,20. 6, 21. 1,21. 7, 22. 2 

22.8,23.3.23.9.24.4,25.0,25.6,26.1,26.7,27.2,27.8,28.3, 
28.9.29.4,30.0)- 

LITERALS  (CTi-1, 1.018, 1.016, 1.014, 1.012, 1.010, 1.008, 1.006, 

1.004,1.002,1.000,0.998,0.996,0.994,0.992,0.990,0.988, 

0.986,0.985,0.983.0.981,0.979.0.977.0.975.0.973.0.972, 

0.970,0.968,0.966,0.964,0.962,0.961,0.959.0.957.0.955. 

0.953.0.952,0.950.0.948,0.946,0.945,0.943.0.941,0.939, 

0.938.0.936,0.934)- 

LITERALS  (BAR, 28. 1,28. 2, 28. 3, 28. 4,28. 5, 28. 6, 28. 7, 28. 8, 

28.9,29.0,29.1,29.2,29.3.29.4,29.5.29.6,29.7,29.8,29.9. 

30.0,30.1,30.2,30.3,30.4,30.5,30.6,30.7,30.8,30.9.31.0)- 

LITERALS  (CBM, 0.939, 0.942, 0.946, 0.949, 0.953. 0.956. 0.959. 
0.963.0.966,0.970,0.973.0.976,0.979.0.983,0.986,0.989. 
0.992.0.996,0.999.1.003,1.007,1.010,1.013,1.016,1.020, 
1.023.1.026,1.029,1.033.1.036)- 


' 


CT  =  0- 

D0  THROUGH  (GEDT),  I&=0,1,IG.L.^5- 

JG  =  IG  +  1- 

PROVIDED  (TEMP.GE.CENT(IG).AND.TEMP.LE.CENT(JG)), 

CT  =  CTM(IG)  +  (CTM(JG)  -  CTM(IG))  *  (TEMP  -  CENT(IG))/ 

((CENT(JG)  -  CENT(IG))- 

PROVIDED  (CT.G.O), TRANSFER  (G01)- 

GEDT   CONTINUE- 

G01    CB  =  CD- 
DO  THROUGH  (GEDP),  IB=0,1  .IB.L.29- 

JB  =  IB  +  1- 

PROVIDED  ( PRESS. GE.BAR( IB). AND. PRESS. LE.BAR(JB)), 
CB  =  CBM(IB)  +  (CEM(JB)   -  CBM(IB))  +  (PRESS  - 
BAR(IB))/(BAR(JB)  -  BAR(IB))- 

PROVIDED  (CB.G.O.),   TRANSFER  (G02)- 
GEDP       CONTINUE- 
G02         RT  =  0- 

DO  THROUGH  (GETZ),  1=0, 1,1.  L.  5^- 

J  =  I  +  1- 

PROVIDED  (ZDR.GE.ZA(l).AND.ZDR.LE.ZA(j)),    RT  =  RM(l)  + 
(RM(J)  -  RM(I))   *  (ZDR  -  ZA(I))/(ZA(J)  -  ZA(I))- 

PROVIDED  (RT.G.O.),   TRANSFER  (FINAL)- 

GEDZ       CONTTNUE- 

FINAL     RCGS  =  RT  *  CT  *  CB- 
NORMAL  EXIT- 
END  SUBPROGRAM- 
END  PROGRAM  (START)- 


SCATRAN  SUBROUTINE 

FOR  THE 

BALDINI   REFRACTION  MODEL 

SUBROUTINE  (RB)  =  REFBAL.    (RH.TDC.ATPRS.ZST)- 

DIMENSION  (HEAT(IO).HG(IO))- 

PATM  ■  ATPRS   *  25.39998- 

LITE1ULS   (HEAT, -5. 0,0. 0,5. 0,10. 0,15. 0,20. 0,25. 0,30.0, 

35.0,^0.0)- 

LITERALS  (HG.3. 02, ^.58,6. 5^,9. 21. 12.79, 17.55. 23. 78. 
31. 86, 42. 23, 55.^)- 

HGMM  =  0  - 

DO  THROUGH  (VAPOR).   IF  =  0.1.IF.L.9- 

JF  =  IF  +  1- 

PROVIDED  (TDC.GE.HEAT(IF).AND.TDC.LE.HEAT(JF)),  HGMM= 
HG(IF)  +(HG(JF)  -  HG(IF))    *  (TDC  -  HEAT(lF))/5.0- 

PROVIDED  (HGMM.G.O),   TRANSFER  (CONT)- 
VAPOR     CONTINUE  - 
CONT       E  =  RH  *  HGMM- 

SLITE  =  0.578- 

AO  =  0.99827- 

Al  =  -O.OOI3O- 
A2  =  0.000006 

FNG  ■  2876.04  =  16.288/(SLITE.P.2)  +  0.136?(SLITE.P.4)- 
FNG  =  FNG  *  1.0.X.-7- 

FNO  =  (FNG/(1.0  +  0.00367  *  TDC))   *  PTAM/760.0  - 
(5. 5.X. -8)   *  E/(1.0  +  0.00367  *  TDC)- 

FNO  =  FNO  *  206264.81- 

TAN  =  SIN.(ZST)/COS.(ZST)- 

RB  ■  FNO  *  AO  *   TAN  +  FNO  *  Al   *  (TAN. P. 3)  +  FNO  *  A2   * 
(TAN. P. 5)- 
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NORMAL  EXIT- 
END  SUBPROGRAK- 


■  •' 


SCATRAN  SUBROUTINE 
FOR  THE 
GARFINKEL  REFRACTION  MODEL 
ABERDEEN  VERSION 

SUBROUTINE  (R)  =  REFGAR.    (ZOB.FP.TM)- 

CALL  SUBROUTINE  (    )  =  FPSET.   (3.HALT)- 

HALT       CONTINUE- 

LITERALS   (FN, 4.256, FK,^472. 8, BE, 0.04^385, GAMA, 8. 7137)- 

UPPER  COMMON  (IND)- 

BOOLEAN  (IND)- 

DIMENSION  (B(5))- 

PR  =  PP/ 760.0   *  25.3998- 

T  =  lM/273.16  +  1.0- 

W  =  pr/t/t- 

TRANSFER  (GR15.GR12.GR12)  PROVIDED  (ZOB  -  0.785398163^). 
GR15       TANTA  s  SIN.(ZOB)/COS.(ZOB))   *  SQRT.(T)/GAMA- 

TKETA  =  ATAN.(  TANTA  )- 

TRANSFER  (GR120)- 
GR12   TANTA  =  GAMA  *  (COS.(ZOB)/SIN.(ZOB))/SQRT.(T)- 

THETA  =  ATAN. (1.0/ TANTA )- 

PROVIDED  (TANTA.E.O),  THETA  =  ZOB- 
GR120  PS  =  0.0- 

S  =  0.0- 

SUM  =  0.0- 

DO  THROUGH  (GR33).  1=1.1 , I. LE. 5- 

DO  THROUGH  (GR32),  J=l,l , J.LE.I- 

FI  =  I  -1- 

FJ  =  J  -1- 

FM  =  FN  *  (FI  -  FJ  +  1.0)  -  FI- 
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FJJ  ■  FJ  4  1.0- 

CALL  SUBROUTINE  (  )  =  GAMMA.  (FTJJ.FIJJ)- 

PROVIDED  (IND),  TRANSFER  (GR200)- 

FIJJ  =  FI  -  FJ  +  1.0- 

CALL  SUBROUTINE  (    )  =  GAMMA.    (FIJJ.FIJJ)- 

PROVIDED  (IND),    TRANSFER   (GR200)- 

FMS  =  FM  +  1.0- 

CALL  SUBROUTINE  (  )  =  GAMMA.  (FK.FMG)- 

PROVIDED  (IND),  TRANSFER  (GR200)- 

CALL  SUBROUTINE  (  )  ■  GAMMA.  (FMS.FMS)- 

PROVIDED  (IND),  TRANSFER  (GR200)- 

D  =  FMG  *  FMS- 
GR100  TRANSFER  (GR13.GR31.GR1 3)  PROVIDED  (FM  -  S)- 
GR13   D  =  (FM  +  S)/(FM  -  S)  *  D- 

KK  =  2.0  *  S  +  1.0- 

CH  =  C0S.(THETA/2.0).P.KK- 

SH  =  SIN.(THETA/2.0).P.KK- 

TA  =  SH/CH- 

TRANSFER  (GR132,   GR131.   GR13D  PROVIDED  (SH  -  0.707106 78). 
GR131     CN  =  CH/SH- 

TA  =  1.0/CN- 
GR132     PI  =  FMG   *  FMG/D  *   TA- 

TRANSFER  (GR14,   GR30,    GR14)   PROVIDED  (FM  -  S  -  1.0)- 
GR14       D  =  (FM  +  S  +  1.0)/(FM  -  S  -  1.0)    *  D- 

KK  +  S   *  2.0  +  3.0- 

ST  n  SIN.(THETE/2.0).P.KK- 

CT  =  COS.(THETE/2.0).P.KK- 
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TN  =  ST/CT- 

TRANSFER  (GR142.   GRIM,    GRIM)  PROVIDED  (ST  -  0.7.710678). 

GR141      CN  =  CT/ST- 
TN  =  1.0/CN- 

GR142     PI  +  PI  +  FMG  *  FMG/D  *  TN- 

GR143     PS  =  PS  +  PI- 
TRANSFER  (GR16,   GR31,   GR16)  PROVIDED  (PI)- 

GR16       S  =  S  +  2.0- 

TRANSFER  (GR17,  GR24,  GR1?)  PROVIDED  (S  -  2.0)- 

GR17   TRANSFER  (GR24,  GR24,  GR30)  PROVIDED  (S  -  FM)- 

GR24   P  =  PI- 
TRANSFER  (GR100)- 

GR30       PS  =  PS  +  Pl- 

GR31       FMNIF  =  FM  +  FI- 

CALL  SUBROUTINE  (    )  =  GAMMA.   (FMNIF,  FMNIF )- 
FMM  =  (-l.O).P.(J-l)    *  FMNIF/(FJJ  *  FIJJ  *  FMG)- 
SUM  =  SUM  +  FMM  *  PS- 
PS  =  0.0- 

GR32       S  =  0.0- 

B(I)  =  FK  *  BE.P.(I-I)   *  SUM- 

GR33       SUM  =  0.0- 

R  =  SQRT.(T)    *  W  *   (B(l(   +  W  *  (B(2)  +  W   *   (B(3)  ♦  W  * 
(B(4)  +  W  *  (B(5)))))- 

NORMAL  EXIT- 
GR200     CALL  SUBROUTINE  (    )  =  ENDJOB.   (    )- 
END  SUBPROGRAM- 
SUBROUTINE  (    )  =  GAMMA.    (Z.GZ)- 
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LITERALS  (CI ,0.001917526918,02, 0.0008417508418, 

03,0.0005952381,04,0.0007936507936508,05,0.0027777777777, 
C6, 0.08333333333. C7. 0.9189358533)- 

UPPER  COMMON  (IND)- 

BOOLEAN  (IND)- 

X  =  Z- 

CV  =  1.0- 
GA9     TRANSFER  (GA10,  GA11,  GA11)  PROVIDED  (X  -10.0)- 
GA10    CV  =  CV  *  X- 

X  =  X  +1.0- 

TRANSFER  (GA9)- 
GA11    TRANSFER  (GA12,  GA80,  GA12)  PROVIDED  (CV)- 
GA12    TRANSFER  (GA10,  GA13,  GA13)  PROVIDED  (.ABS.CV  -  1.0)- 

GA13   ZZ  =  1.0/x/x- 

FX  =  (((((CI  *  ZZ)  +  C2)  *  ZZ  -  C3)  *  ZZ  +  C4)  *  ZZ  -  C5) 
*  ZZ  +  C6- 

FX  =  FX/X- 

G  =  (X  -  0.5)  *  LN.(X)  +  C7  -  X  +  FX- 
TRANSFER  (GA14,  GA90,  GA90)  PROVIDED  (G  -  700.0)- 
GA14    GZ  =  EXPE.  (G)/CV- 

NORMAL  EXIT- 
GA80    WRITE  OUTPUT,  F8l,  (Z)- 
F  F81     (34K  GAMMA  OF  ZERO  OR  NEGATIVE  INTEGER,  E14.8)- 
IND(=).0. 777777777777- 
NORMAL  EXIT- 
GA90    WRITE  OUTPUT,  F91,  (Z)- 
F  F91     (44K  GAMMA  FUNCTION  WILL  EXCEED  MACHINE  CAPACITY,  E24.8)- 
IND(=).0. 777777777777- 
NORMAL  EXIT- 
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END  SU3PR0GRAM- 
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SCATRAN  SUBROUTINE 
FOR  THE 
GARFINKEL  REFRACTION  MODEL 
U.   S.   COAST  AND  GEODETIC  SURVEY  VERSION 

SUBROUTINE  (R)  =  REFGAR.    (ZZ,PR,TT)- 

FLOATING  (N1,N2,N3,N^)- 

LITERALS  ( Nl, 1050. 61030, N2. 706. 11502, N3, 262. 06086, 
N4, 142. 67293. GAMMA, 8, 7137)- 

T  =  TT/273.16  =  1.0- 

P  =  PR/760.0   *  25.39998- 

W  =  P/(T  *  T)- 

TANB  =  (SQRT.(T). GAMMA)    *  (SIN.(ZZ)/COS.(ZZ))- 

B  =  ATAN.(TANB)- 

BH  ■  B/2.0- 

TANBH  s  SIN.(BH)/COS.(BH)- 

FT  =  W  *   (SQRT.(T))- 

R  s  FT  *  ((Nl   *  TANBH)  +  (N2  *  (TANBH.P.3))  + 
(N3  *  (TANBH. P. 5))  +  (N4  *  ( TANBH. P. ?)))- 

NORMAL  EXIT- 
END  SUBPROGRAM- 
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SCATRAN  SUBROUTINE 
FOR  THE 
GARFINKEL  REFRACTION  MODEL 
ACIC  FORM 

SUBROUTINE  (REF)  =  REFGAR.  (ZEN.PRS.TM)- 

DIMENSION  (FNl(6l),FN2(50).FN3(l5))- 

LITERALS   (FN1, O.O, 8. 7, 17. 3. 25.9. 34.6. 43. 3, 52. 0,60.7,69. 5. 

78. 3, 87. 1.96. 0,104.9,113.8,122.9.131.9.1^1.0, 150. 2, 159. 6, 

168.9,178.3.187.8,197.4,207.1,216.9,226.9,237.0,247.1, 

257.4,267.9.278.5.289.2,300.1,311.2,322.4,333.9,3^5.9. 

357. 3. 369. ^.381. 7. 394.2, 407. 0,420. 0,433. 3. ^^6.9. 460. 8, 

475.0,469.6,504.5,519.7,535.^.551.5,567.9.584.9.602.4, 

620.3,638.8,657.8,677.4,697.7,718.6)- 

LITERALS  (FN2, 0.0, 0.0, 0.0, 0.1, 0.1, 0.1, 0.1, 0.1, 0.2, 0.2, 
0.2,0.3.0.3,0.4,0.4,0.5,0.6,0.7,0.7,0.8,0.9,1.0,1.1,1.2, 
1.4,1.5,1.7.1.9.2.1.2.3,2.5.2.7.3.0,3.3.3.6,3.9.4.3.^.7. 
5.1.5.5.5.9.6.5.7.0,7.6,8.3,9.0,9.7,10.5.11.4,12.4)- 

LITERALS  (FN3, 0.0, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.2, 0.2, 
0.2,0.2,0.3.0.3.0.4)- 

TS  =  273.0/(TM  +  273.0)- 

T  =  SQRT.(TS)- 

GAMMA  =  8.1578- 

P  =  (PRS/760.0)    *  25.39998- 

W  =  P  *  TS   *  TS- 

COTZ  =  COS.(ZEN)/SIN.(ZEN)- 

GAMO  =  GAMMA  *  T- 

TAN  =  1.0/(GAM0  *  COTZ)- 

THETA  =  ATAN.(TAN)- 

ANG  =  THETA  *  57.2957795- 

DO  THROUGH  (ONE),   1=0,1,1 . L.60- 

J  =  I  +  1- 

PROVIDED  (ANG.L.I.OR.ANG.G.J.),    TRANSFER  (ONE)- 

Bl  =  FN1(I)  +  ((FN1(J)   -FNI(I))    *  (ANG  -  I))- 
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PROVIDED  (I.LE.IO),    TRANSFER  (SET1)- 

IK  +  I  -  11- 

JK  =  J  -  11- 

B2  ■  FN2(IK)  +  ((FN2(JK)   -  FN2(IK))    *  (ANG  -  I))- 

PROVIDED  (I.LE.^5).    TRANSFER  (SET2)- 

IM  =  I   -  46- 

JM  ■  J  -  46- 

B3  +  FN3(IM)  +  ((FN3(JM)  -  FN3(IM))    *  (ANG  -  I))- 

TRANSFER  (OUT)- 
SET1        B2  =  0.0- 
SET2       B3  =  0.0- 

TRANSFER  (OUT)- 
ONE         CONTINUE- 
OUT         REF  =  (W*B1)/T  +  (W  *  W  *  B2)/T  +  (W  *  W  *  W  *  B3)/T- 

NORMAL  EXIT- 
END  SUBPROGRAM- 
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SCATRAN  PROGRAM 

FOR  T 

COMPARISON  OF  THE  REFRACTION 

GIVEN  BY  THE  THREE  MODELS 

FOR  VARIOUS  TEMPERATURE 

AND  PRESSURE  COMBINATIONS 

DIMENSION  (RM(5^1).ZA(54l))- 

START     READ  IMPUT,    USREF,    ((RM(K),    K=0,l,K.LE.54O)). 

F  USREF     (12F5.1)- 

DO  THROUGH  (TABLE),  1=0,1 , I. L. 5^0- 

DO  THROUGH  (TABLE),   J=0,1.J.L.6- 

IJ  =  I  +  J- 

ZA(IJ)  =  (1/6.0)  +  (J  *  0.16666666?)- 
TABLE     CONTINUE- 

ZA(5^0)  =  90. 0- 

RHUM  =  0.60- 

DIMENSION  (CENT(3).PRSMM(4))- 

LITERALS  (CENT, -5. 0,10.0, 35.0)- 

HTERALS  (PRSMM, 711. 0,737. 0,760. 0,787. 0)- 

DO  THROUGH  (END),   1=0, 1,1. L. 3- 

CTEM  =  CENT(I)- 

DO  THROUGH  (END),    J=0,1,J.L.4- 

WRITE  OUTPUT,  Fl- 

PRSIN  =  PRSMM  (J)/25.39998- 

DO  THROUGH  (ONE),   K=0,1,K.L.19- 

FACT  =  K- 

ZD  =  5.0   *  FACT- 

ZRAD  =  ZD/ 57. 2$  5779 5- 
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CALL  SUBROUTINE  (COAST)  =  REFCGS.   (RHUM.CTEM.PRSIN.ZRAD)- 
CALL  SUBROUTINE  (BALD)  =  REFBAL.    (RHUM.CTEM.PRSIN.ZRAD)- 
CALL  SUBROUTINE  (GARF)  =  REFGAR.    (ZRAD.PRSIN.CTEM)- 
WRITE  OUTPUT,   F2,    ( ZD, COAST, BALD, GARF)- 

ONE         CONTINUE- 

WRITE  OUTPUT,   F3,    (CENT(l),PRSMM( J))- 

END         CONTINUE- 

F     F*  (1H1,Q$  COMPARISON  OF  REFRACTION  FROM  0  TO  90  DEGREES  AT 

FIVE  DEGREE  INTERVALS$//Q$  ZENITH  DISTANCE  $,5X.Q$  COAST 
AND  GEODETIC  SURVEY  MODELS, 5X,Q$  BALDINI  K0DEL$.5X,Q$ 
GARFINKEL  K0DEL$)- 

F     F2  (//6X,F4.1,20X,F10.6,19X,F10.6,10XtF10.6)- 

F     F3  (//Q$  ABOVE  VALUES  ARE  IN  SECONDS  OF  ARC$//Q$  THIS  DATA 

WAS  COMPUTED  FOR  A  WAVE  LENGTH  OF  0.578  MICRONS$//Q$ 
RELATIVE  HUMIDITY  EQUALS  60  PER  CENT$//Q$  CENTIGRADE 
TEMPERATURE  EQUALS$,F7.l//Q$  ATMOSPHERIC  PRESSURE  EQUALS$, 
F7.1,1X,Q$  millimeters $)- 

CALL  SUBROUTINE  (    )  =  END JOB.   (    )- 

U.   S.  COAST  AND  GEODETIC  SURVEY  SUBROUTINE 

(MODIFIED  FOR  A  LARGER  RANGE  OF  TEMPERATURE  AND  PRESSURE) 

BALDINI  SUBROUTINE 

GARFINKEL  SUBROUTINE 

END  PROGRAM  ( START )- 
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COMPARISON  OF   THE  GARFINKEL  MODEL  SUBROUTINES 


Zenith 
Distance 
(decrees) 

Aberdeen 
Version 

Coast  and 
Goodotic 
Survey 
Version 

Aberdeen 
Version 
Original 
Constants 

ACIC 
Form 

0 

0.000 

0.000 

0.000 

0.000 

5 

5.090 

5.088 

5.123 

5.157 

10 

10.257 

10.254 

10.325 

10.367 

15 

15.587 

15.582 

15.690 

15.702 

20 

21.171 

21.164 

21.311 

21.288 

25 

27.120 

27.112 

27.300 

27.266 

30 

33.574 

33.564 

33.796 

33.784 

35 

40.711 

40.699 

40.980 

40.979 

40 

48.775 

48.760 

49.097 

49.091 

^5 

58.107 

58.091 

58.492 

58.463 

50 

69.216 

69.198 

69.674 

69.685 

55 

82.887 

82.867 

83.435 

83.422 

60 

100.414 

100.393 

101.079 

101.059 

65 

124.100 

124.801 

124.922 

124.922 

70 

158.465 

158.457 

159.418 

159.554 

75 

213.740 

213.770 

215.169 

215.100 

80 

318.633 

318. 825 

320.830 

320.933 

85 

589.651 

590.955 

59^.659 

594.666 

Temperature  s  10°  Centegrade 
Pressure  =  76O.O  mm  of  Hg 

Refraction  in  Seconds  of  Arc 


85 


APPENDIX 
II 
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ADJUSTMENT  OF  THE  REFRACTION  MODEL 
FOR  STATION  CONDITIONS 


This  adjustment  procedure  makes  use  of  the  Gonoral  Method  of 

Adjustments  to  obtain  a   solution  for  the  variation  of  the  assumed 
(10) 


The  general  matrix  form  may  be  represented  in  matrix 
-Ipi 


parameters . 

notation  as 

BF~1B'  A  Kj^  W 

A'  OX  0 

or  may  be  given  in  a  matrix  equation  as 

BV  +  AX  +  W  =  0. 

In  these  forma  all  letters  represent  matrices  (with  the  exception  of 

the  subscript).   The  A,  B  and  W  matrices  are  defined  as 

A  =  a  F 

^Xo 
B  =  _1F 

whore  L^  represents  the  observed  quantities,  L  represents  the  adjusted 
values  of  the  observed  quantities,  X  represents  the  assumed  parameters 
and  X  represents  the  adjusted  values  for  the  parameters.   Other  matrices 
used  in  the  solution  of  the  equations  are  the  V  matrix  which  gives  the 
residuals  for  the  observation,  the  X  matrix  which  gives  the  corrections 
to  the  assumed  paramotors  and  the  P  matrix  which  is  the  weight  matrix. 
The  prime  symbols  on  the  matrix  indicate  that  it  is  the  transpose  of  the 
matrix  whose  letter  is  used  and  the  minus  one  notation  indicates  that 
this  matrix  is  the  inverse  of  the  matrix  whose  letter  is  used.   De- 
fining a  new  matrix  as 


87 


M  =  BP"1B» 
the  final  form  of  the  equation  for  the  X  matrix  is  given  as 

X  =  -(A'M"1A)"1  A'I-f  XW  . 
For  an  adjustment  to  take  place  the  condition  must  bo  satisfied 
that 

n  +  u  :>  r  ■>  u 
where  n  is  the  number  of  observations  of  the  observed  quantities,  u  is 
the  number  of  unknown  parameters  and  r  is  the  number  of  condition 
equations.  'When  these  conditions  are  fulfilled  then  thn  adjustment 
can  take  place.    ' 

The  above  factors  and  principles  are  then  an  outline  of  the 
method  which  was  used  to  attempt  to  adjust  the  refraction  coefficients 
for  the  conditions  at  the  stations. 

Two  mathematical  structures  were  employed  in  the  adjustment 
attempt  with  two  separate  attempts  being  used  to  make  the  adjustment. 
In  the  first  instance  the  observed  quantities  were  the  observed  al- 
titude and  hour  angle  of  each  star.   This  gave  four  observed  quantities 
per  condition.  In  the  second  instance  only  two  observed  quantities 
were  required,  these  being  the  altitude  and  azimuth  for  the  single  star 
inquestion.  In  both  cases  the  parameters  were  the  three  refraction 
model  coefficients  and  the  assumed  latitude.   The  declination,  tempera- 
ture, pressure  and  time  between  direct  and  rovorse  sightings  of  the 
instrument  were  considered  not  to  vary  for  the  purposes  of  the  adjustment, 

The  equation  used  for  the  refraction  model  was   based  on  the 
ACIC  form  of  the  Garfinkel  Model  which  is  given  here  as 

R  =  '/T^  W^X  cot  hQ  +  N2K3  cot3h  +  N  K5  cot5!^ 
where 
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w  =  P/Tq 

K  =  T  /y 
o'  c 

with  Y    assigned  the  Aberdeen  value  of  8.7137.   In  this  form  P  and 

T0  are  the  relative  pressures  and  temporatures.   Those  quantities 

are  obtained  from  the  relation 

T     =  T     +  273.16 
o  o 

273.16 
P  =  P/ 760.0 
where  the  observed  temperature  is  in  degrees  centigrade  and  the 
observed  pressure  is  in  millimeters  of  mercury.      Tho  cotangent  func- 
tion appears  in  the  equation  since 

tane   =     T0     tan  ZQ  =     T0  cot  hQ 

T  T 

where  ZQ  is  the  observed  zenith  distance  and  h  is  the  observed  alti- 
tude. 

The  relation  may  also  be  established  that 

h  =  hQ  +  R 
where  h  is  the  observed  altitude  after  correction  for  the  refraction 
and  R  is  the  refraction  correction  from  the  refraction  model.   These 
relationships  will  be  used  in  the  normal  equation  coefficients  which 
are  derived  for  each  mathematical  structure. 

The  first  mathematical  structure  investigated  was  based  on  the 

fact  that,  if  all  things  were  perfect, the  latitude  obtained  from  an 

observation  of  a  south  circummeridian  star  would  be  tho  samo  as  that 

obtained  from  the  observation  of  Polaris.   This  is  fitting  the  more 

genoral  statement  that  tho  latitude  obtained  from  the  north  star  should 

be  the  same  as  the  latitude  obtained  from  the  south  star  to  our  avail- 
able data,   Tho  basic  condition  is  then  that  the  difference  of  these 
two  values  be  equal  to  zero.   This  mathematical  structure  is  given  as 
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0 
N    '  S   = 

with  the  subscripts  denoting  the  nortli  and  south  stars.   The  reduction 

methods  used  by  Thorson^'  v;ore  used  to  obtain  these  values  in  torms 

of  the  observed  values  and  parameters.   Using  Polaris,  the  latitude 

from  the  north  star  observation  becomes 

(p^   =  h  -  P  cos  t  +  B 

whore 

P=  (90°  -S) 


;P2 


B  =  2s     tan  h  sin  t 


with  t  representing  the  hour  angle,  J»  representing  the  declination  and 

h  being  the  corrected  altitude  of  Polaris.   Tho  latitude  from  the 

circunmeridian  star  may  bo  represented  as 

0S  =  6  -  h«  +  90° 

where 

h'  =  h  +  Am 

m  =  m^   +  m2  =  0.0001364( k  TS)2  +  sin2|t 

A  =  cos  ^>  cos  <$> 
cos  h 

with  h  representing  the  corrected  altitude,    t  given  as  the  hour  angle 

of  the  south  star,    &    representing  the  declination  and     /s.  Ts  given  as 

the  time  in  seconds  between  the  direct  and  reverse  pointings  of  the 

instrument.     Now  denoting  the  north  star  quantities  with  an  asterisk 

and   tho  south   star  quantities  with  no  superscript  the  mathematical 

structure  may  bo  written  as 

h*  -  R*  -  P  cos  t*  +  2P     tan  (h*  -  R*)  sin2t* 

o  ->+h  -R  +  cos  Scos  <fi     0.000136^(f.-.Ts)2  +  2  sin^t  =  0. 
-90  cc  (.nc-k) 
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Since  eight  observations  are  taken  of  the  north  and  south  stars 
individually,  this  mathematical  structure  gives  eight  conditions  to 
be  fulfilled.   There  are  four  assumed  parameters  and  a  total  of  thirty- 
two  observed  quantities.   This  gives  the  values 

n  -  32 

r  -  8 

u  -  4 
which  when  used  to  ascertain  if  an  adjustment  will  take  place  gives 
the  relation 

(32  +  4)>8;>4. 
Therefore,  an  adjustment  can  exist  for  this  amount  of  data  used  in  the 
above  mathematical  structure. 

The  A  and  B  matrices  are  the  ones  whose  form  we  are  concerned 
with  here.  All  abservations  are  taken  to  be  of  the  same  weight  which 
causes  the  P  matrix  to  be  a  unit  matrix  which  may  be  dropped  from  the 
equations.   It  should  be  noted  here  that  the  values  of  the  altitude  and 
hour  angle  are  correlated  and  that  possible  weights  should  be  assigned 
to  take  account  of  this  fact.   The  A  matrix  takes  the  form 


iUl 


A.? 


and  the  £  matrix  is  of  the  form 


A? 


r\ 


j 


O  ' "O  ^   "O 

For  simplification  in  the  writing  of   the  formulas   for  these  partial 

derivatives   some  factors  will   be  designated  for  use   in  the  formulas. 
These  fnctors   are 


FR  -  NL  \f*o        1  +   3N2  [^  cot2Q     + 

,)     sin^h0  v  r)  /     sin^h0 


5N- 


*  5  cotV 


:in'^hf 
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FW  =  A/  T 
l     o 

FN  =  \ To  cot  hQ 

p^  g.     cos  &  cos   .'  sin     (hQ-  R) 
cos^(h0-    R) 

FPOL     =  j-?*-  sin2t* 


FCIR     *  sin   (h0-    R) 


cos   (h    —    R) 
o 


which  vri.ll  be  used  along  with   the  factors  A  and  m  defined  above. 
The  partial  derivitaves  for  the  A  and  B  matrices  may  now  be  written 

•^g     =     1     +  Fi'/(FR*)     +  FPOL     [7  +  FW(FR*)J 
4-L-  =     P  sin  t*  +  P2  tan  (H*-  R*)  sin  t*  cos  t* 

it  =  »  +  ™(FR> +    %.  (ho  r)  C1  +  r-,(FR)] 

^  -  =    cos  <>  cos  v£   (2  sin  ft   cos  £t) 
^       cos  (hQ-  R) 

^—  =  -FW(  FN* )  -  FW(  FN*  ) FPOL  -  FW(  FN )  ( Am  )FCIR 

^|L_  =  -FV/(FN*p-F./(FN*)3  FP0L-F//(FN)"*-FW(FN)3(Am)FCIR 
^N2 

^-|—  =  -F.V(FN*)5-  F,/(  FN*)5  FPOL^Fi(FN)5-Fi'/(FN)5(Am)FCIR 
a  No 

A  F   =  -Am  tan  </> 

where  the  valuos  with  the  askorisk  once  again  represent  values  computed 

from  the  north  star  and  those  same  values  without  a  superscript  represent 

these  quantities  computed  from  the  south  star.   These  derivitives  are 

rather  involved  and  a  simpler  system  would  be  more  desirable  if  it 

could  bo  found. 

A  simpler  and  more  general  method  of  expressing  the  mathematical 

structure  is  to  use  the  first  equation  for  the  astronomical  triangle 
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given  in  Section  4.1.   This  gives  the  form 

sin  [p  sin  ^  +  cos  c  cos  s  cos  t  —  sin  h  =  0 
where  the  quantities  used  in  the  formula  are  the  same  as  those  which 
were  described  above.   In  this  method,  each  star  observation  must  ful- 
fill the  condition  given  by  the  mathematical  structure. 

For  this  method  thore  are  thirty  two  observed  quantities,  six 
tcon  conditions  to  be  fulfilled  and  four  unknowns.   The  data  used  for 
this  method  was  the  same  as  in  the  case  of  the  first  mathematical 
structure  given  above.   The  assumed  parameters  remain  the  same  in 
this  adjustment  and  therefore  thore  is  no  change  in  the  general  form 
of  the  A  matrix.   The  B  matrix  is  reduced  to  two  terms  since  only  the 
observation  of  a  single  star  is  considered  for  each  condition.   This 
lets  the  B  matrix  assume  the  form 


where  t  is  now  the  hour  angle  of  the  observed  star  and  h  the  observed 

o 

altitude  with  no  distinction  being  made  for  the  north  and  south  stars. 
For  this  method  the  values 

n  =  32 

r  =  16 

u  s  4 
are  obtained  which  give  the  relation 

(32  +  4)    *>     16     >     4. 
This  relation  shows   that  an  adjustment  can  exist  for  this  mathematical 
structuro  with   the  available  data. 

The  partial  dorivitavos   for  this  method  are  easier  to  work  with 
than  those  which  wore   taken  from  the  previous  mathematical  structuro. 
Using   the  constant  factors   FW,    FIJ  and  FR  from  abovo   the  partial 
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derivatives  bocomo 


tt .  .  =   -  cos  y 1  cos  \   sin  t 


^-=   cos  (h  -  R) 


1  +  FW(FR) 


^§-=  -cos(hQ-  R)  (FW)  (FN) 


v>N 


4S-=  -cos(h  -  R)  (FW)  (FN)3 


*N2 

^L  =  -cos(h  -  R)  (FW)  (FN) 

2_£_  =   cos  /  sin  §>  —  sin  sd  cos  £>  cos  t 
with  these  values  being  computed  for  each  observed  star. 

In  both  of  these  adjustment  methods  given  above  the  W  matrix 
can  be  computed  from  the  mathematical  structure.   Then  with  the  A,  B 
and  '/!  matrices  the  matrix  equations  can  be  used  for  each  adjustment  and 
a  solution  should  be  obtained  if  the  data  are  not  too  strongly 
correlated. 

The  values  for  the  refraction  model  coefficients  wore  selected 
as 

Nl  =  522.5 

M2  =  86.9 

N-  =   8.2 
from  an  examination  of  tho  Garfinkel  model  output  for  zonith  distances 
from  ^K)  to  60  degrees.   Tho  numorical  values  given  above  aro  an  average 
of  all  the  coefficient  values  obtained  by  this  process. 
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